-- Logs begin at Thu 2022-10-20 18:34:26 UTC, end at Thu 2022-10-20 19:30:37 UTC. -- Oct 20 19:04:41.242322 dv-osbrick-862183-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Oct 20 19:04:41.251762 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 20 19:04:41.253654 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 20 19:04:41 2022] *** Oct 20 19:04:41.253654 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 20 19:04:41.253654 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 20 19:04:41.253654 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: nodename: dv-osbrick-862183-1-ceph Oct 20 19:04:41.253654 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: machine: x86_64 Oct 20 19:04:41.253654 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: clock source: unix Oct 20 19:04:41.253654 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: pcre jit disabled Oct 20 19:04:41.253654 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: detected number of CPU cores: 4 Oct 20 19:04:41.253654 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: current working directory: / Oct 20 19:04:41.253654 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: detected binary path: /usr/bin/uwsgi-core Oct 20 19:04:41.253654 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: your processes number limit is 47680 Oct 20 19:04:41.254231 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: your memory page size is 4096 bytes Oct 20 19:04:41.254231 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: detected max file descriptor number: 2048 Oct 20 19:04:41.254231 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: lock engine: pthread robust mutexes Oct 20 19:04:41.254231 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: thunder lock: enabled Oct 20 19:04:41.254231 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 20 19:04:41.254231 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 20 19:04:41.298276 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: Python main interpreter initialized at 0x55da72e7c9c0 Oct 20 19:04:41.298276 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: python threads support enabled Oct 20 19:04:41.298276 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: your server socket listen backlog is limited to 100 connections Oct 20 19:04:41.298276 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: your mercy for graceful operations on workers is 90 seconds Oct 20 19:04:41.298650 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: mapped 403077 bytes (393 KB) for 2 cores Oct 20 19:04:41.298730 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: *** Operational MODE: preforking *** Oct 20 19:04:41.298941 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: *** uWSGI is running in multiple interpreter mode *** Oct 20 19:04:41.298941 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: spawned uWSGI master process (pid: 88300) Oct 20 19:04:41.299142 dv-osbrick-862183-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Oct 20 19:04:41.300318 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: spawned uWSGI worker 1 (pid: 88307, cores: 1) Oct 20 19:04:41.300318 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: spawned uWSGI worker 2 (pid: 88308, cores: 1) Oct 20 19:04:41.300318 dv-osbrick-862183-1-ceph devstack@keystone.service[88300]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 20 19:04:45.915578 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 19:04:45.915578 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: from cryptography.utils import int_from_bytes Oct 20 19:04:45.916398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 19:04:45.916398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: from cryptography.utils import int_from_bytes Oct 20 19:04:45.920972 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 19:04:45.920972 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: from cryptography.utils import int_from_bytes Oct 20 19:04:45.921442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 19:04:45.921442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: from cryptography.utils import int_from_bytes Oct 20 19:04:45.967240 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 19:04:45.967387 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 19:04:45.967552 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] command line args: [] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 19:04:45.967822 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 19:04:45.968002 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ================================================================================ {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 19:04:45.968257 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] admin_token = **** {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.968534 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] config_dir = [] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.968724 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.968907 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] config_source = [] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.969088 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] debug = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.969288 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.969601 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 19:04:45.969687 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.969788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 19:04:45.969869 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.969969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] command line args: [] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 19:04:45.970064 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.970233 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 19:04:45.970317 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.970423 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ================================================================================ {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 19:04:45.970525 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] list_limit = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.970654 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] admin_token = **** {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.970763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] log_config_append = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.970864 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.970956 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] config_dir = [] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.971078 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] log_dir = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.971173 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.971272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] log_file = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.971371 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] config_source = [] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.971489 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.971618 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] debug = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.971618 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.971824 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.971935 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.972047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.972120 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.972241 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.972342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.972457 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.972457 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.972641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.972728 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] list_limit = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.972797 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.972919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] log_config_append = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.973032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.973150 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.973224 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.973342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] log_dir = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.973342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] log_file = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.973532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.973605 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.973717 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.973795 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.973876 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.974003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.974136 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.974242 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.974360 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.974428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.974580 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.974703 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.974822 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.975063 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.975140 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.975260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] publish_errors = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.975342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.975495 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.975613 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.975719 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.975807 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.975902 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.975983 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.976151 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.976233 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.976410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.976501 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.976646 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] standard_threads = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.976790 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.976872 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.977107 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.977273 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.977372 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.977449 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] use_journal = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.977528 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] publish_errors = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.977599 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] use_json = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.977673 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.977768 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] use_stderr = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.977884 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.977966 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] use_syslog = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.978086 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.978164 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.978289 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.978402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.978519 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.978641 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.978750 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] standard_threads = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.978902 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.978986 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.979649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.979732 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.980009 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.980391 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.980754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.981008 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.981243 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.981319 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.981443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] use_journal = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.981528 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.981629 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] use_json = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.981739 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.981816 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] use_stderr = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.981976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.982082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] use_syslog = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.982216 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 19:04:45.982318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.982450 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.982552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.982697 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.982806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.982946 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.983067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.983183 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.983261 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.983435 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.983511 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.983676 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.983754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.983917 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.983992 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.984152 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.984227 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.984430 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.984523 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.984680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.984757 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.984927 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.985003 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.985146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.985224 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.985395 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.985477 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.985627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.985710 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.985857 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.985934 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.986092 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.986168 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.986329 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.986412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.986579 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.986655 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.986809 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.986886 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.987038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.987125 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.987283 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.987368 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.987529 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.987605 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.987765 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.987849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.988021 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.988103 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.988245 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.988346 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.988503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.988592 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.988732 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.988807 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.988960 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.989034 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.989189 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.989274 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.989418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.989496 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.989648 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.989723 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.989877 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.989960 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.990106 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.990189 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.990341 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.990421 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.990575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.990727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.990807 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.990888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.991026 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.991109 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.991254 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.991337 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.991486 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.991563 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.991716 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.991798 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.991943 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.992026 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.992172 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.992248 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.992425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.992505 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.992668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.992757 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.992904 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.992980 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.993138 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.993215 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.993364 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.993449 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.993598 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.993682 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.993825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.993908 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.994058 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.994144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.994289 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.994366 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.994536 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.994612 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.994804 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.995429 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.995691 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.995939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.996057 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.996214 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.996359 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.996488 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.996576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.996741 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.996831 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.996986 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.997064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.997221 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.997305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.997456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.997532 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.997692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.997770 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.997925 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.998008 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.998157 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.998282 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.998390 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.998468 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.998632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.998717 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.998859 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.998936 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.999093 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.999170 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.999329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.999416 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.999565 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.999642 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.999801 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:45.999878 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.000036 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.000121 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.000296 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.000377 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.000531 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.000609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.000766 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.000851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.001000 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.001079 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.001240 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.001317 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.001471 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.001555 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.001707 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.001792 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.001941 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.002018 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.002172 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.002255 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.002406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.002483 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.002636 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.002712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.002865 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.003014 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.003089 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.003157 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.003313 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.003391 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.003542 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.003625 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.003786 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.003871 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.004022 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.004098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.004282 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.004362 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.004523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.004606 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.004756 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.004841 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.004995 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.005073 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.005230 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.005309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.005463 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.005540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] auth.external = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.005692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.005812 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.005919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.005997 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.006148 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.006225 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.006376 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.006453 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] auth.password = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.006610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.006695 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] auth.token = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.006839 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.006942 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.007077 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.007157 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.007311 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.007395 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.007545 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.007623 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.007777 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.007854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.008029 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.008105 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.008313 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.008399 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.008522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] credential.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.008600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.008749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] auth.external = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.008826 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.008978 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.009061 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.009244 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.009320 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.009490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.009574 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.009718 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] auth.password = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.009798 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.009947 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] auth.token = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.010024 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.010184 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.010262 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.010445 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.010548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.010698 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.010953 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.011054 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.011238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.011324 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.011486 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.011564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.011751 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.011829 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.011981 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.012067 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.012217 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] credential.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.012315 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.012491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.012573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] federation.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.012727 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.012814 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.012976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.013055 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.013223 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.013307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.013452 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.013538 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.013683 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.013767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.013921 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.013999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.014170 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.014255 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.014402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.014479 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.014651 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.014728 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.014886 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.014971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.015133 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.015212 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.015368 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.015446 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.015619 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.015698 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.015867 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.015946 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.016099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] federation.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.016176 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.016360 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.016442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.016610 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.016753 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.016830 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.016901 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.017050 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.017126 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.017299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.017439 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.017516 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.017586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.017768 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.017847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.017997 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.018076 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.018228 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.018306 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.018469 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.018548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.018713 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.018789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.018945 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.019021 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.019192 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.019272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.019439 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.019515 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.019670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.019747 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.019906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.019986 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.020150 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.020227 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.020402 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.020481 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.020638 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.020718 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.020870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.020948 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.021108 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.021186 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.021334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.021413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.021564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.021641 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.021791 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.021869 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.022027 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.022105 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.022269 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.022345 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.022512 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.022589 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.022748 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.022828 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.022994 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.023073 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.023240 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.023318 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.023469 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.023548 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.023700 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.023776 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.023927 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.024003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.024159 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.024238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.024417 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.024495 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.024650 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.024726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.024885 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.024964 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.025118 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.025196 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.025364 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.025441 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.025592 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.025672 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.025825 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.025909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.026097 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.026352 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.026597 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.026675 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.026831 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.026914 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.027068 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.027155 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.027306 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.027389 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.027536 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.027617 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.027770 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.027855 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.027998 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.028077 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.028236 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.028383 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.028500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.028587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.028742 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.028820 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.028978 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.029057 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.029211 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.029296 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.029443 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.029521 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.029677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.029754 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.029905 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.029990 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.030136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.030214 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.030362 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.030441 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.030609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.030699 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.030842 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.030920 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.031075 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.031153 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.031308 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.031394 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.031536 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.031614 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.031766 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.031842 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.032012 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.032098 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.032239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.032376 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.032501 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.032578 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.032739 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.032828 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.032975 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.033053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.033211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.033288 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.033438 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.033527 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.033672 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.033750 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.033904 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.033982 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.034137 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.034223 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.034363 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.034441 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.034600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.034676 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.034835 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.034921 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.035072 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.035150 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.035313 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.035390 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.035550 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.035635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.035774 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.035851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.036007 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.036083 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.036240 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.036347 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] resource.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.036497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.036575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.036731 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.036810 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.036964 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.037050 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.037207 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.037285 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.037454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.037530 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.037689 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.037773 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.037933 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.038010 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.038159 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.038235 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.038395 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.038479 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.038625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.038701 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] role.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.038857 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.038934 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] role.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.039087 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.039171 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.039328 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.039405 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.039566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.039644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.039797 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.039946 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.040021 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.040091 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.040257 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] resource.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.040418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.040529 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.040610 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.040773 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.040850 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.041008 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.041147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.041232 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.041304 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.041473 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.041551 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.042477 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.042559 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.042820 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.043073 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.043259 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.043467 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.043545 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.043703 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.043789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.043954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.044033 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] role.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.044201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] role.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.044298 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.044454 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.044545 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.044703 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.044781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.044936 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.045012 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.045181 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.045266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.045427 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.045505 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.045663 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.045739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.045895 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.045981 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.046128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.046206 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.046360 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.046438 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.046587 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.046672 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.046833 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.046912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.047078 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.047157 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.047319 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.047404 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.047557 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.047679 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.047789 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.047939 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.048025 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] token.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.048174 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.048257 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.048446 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.048527 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.048693 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.048783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.048940 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.049018 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.049186 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.049265 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.049418 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.049504 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.049663 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.049739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.049906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.049984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.050140 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.050225 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.050367 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.050445 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.050595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.050673 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.050823 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.050909 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.051068 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.051144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.051319 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.051396 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.051561 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.051650 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.051794 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.051880 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.052027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.052105 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.052256 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.052358 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.connection = **** {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.052510 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] token.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.052591 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.052745 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.052823 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.052990 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.053068 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.053224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.053303 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.053468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.053796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.053872 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.053943 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.054021 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.054099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.054170 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.054240 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.054379 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.054457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.054615 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.054698 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.054849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.054926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.055084 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.055161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.055313 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.055392 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.055558 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.055636 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.055803 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.055880 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.056034 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.056114 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.056328 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.056428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.056536 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.056615 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.056708 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 19:04:46.056806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.connection = **** {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.057048 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.057338 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.058014 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.058263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.058500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.058737 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.058974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.059209 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.059453 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.059687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.059927 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.060162 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.060438 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.060675 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.060918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.061148 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.061386 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.061620 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 19:04:46.061789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 19:04:46.086261 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.086491 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.086717 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.088441 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.089728 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.089962 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.095882 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.098428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.124062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.124307 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.125301 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.125537 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.177985 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.179004 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.226882 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.227062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.229165 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.229762 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.293865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.294089 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.294315 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.294401 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.294540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.294626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.294759 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.294853 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.294976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.295059 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.295188 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.295401 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.318518 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.318779 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.318877 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.318998 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.319084 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.319224 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.319309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.319447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.319532 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.319673 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.319764 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.319889 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.319974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.320110 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.331557 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.332160 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.344452 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.344683 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.345832 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.345832 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.345832 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.346022 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.346257 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.346498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.346732 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.346957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.347181 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.347402 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.347615 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.347826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 19:04:46.362977 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.363086 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.363177 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 19:04:46.363287 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 19:04:46.363520 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.363631 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.363713 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 19:04:46.363834 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 19:04:46.363985 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.364110 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.364251 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.364402 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.364543 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.364665 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.364806 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.364925 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.374879 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.375161 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.375337 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.375435 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.375619 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.375701 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.375891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.376172 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.382612 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.383091 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.386133 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.386395 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.386677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.386963 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.387044 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.387249 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.387330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.387534 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.387623 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.387808 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.387889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.388082 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.388163 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.388394 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.388490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.388672 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.388752 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.388940 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.389020 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.389276 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.389566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.389834 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.411825 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.413080 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.413310 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.413597 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.414536 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.414821 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.420065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.420157 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.420381 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.420468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.420681 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.422330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.426999 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.427289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.428688 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.428981 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.431343 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.431640 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.431929 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.432217 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.433031 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.433310 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.433583 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.433724 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.433853 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.434018 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.434304 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.434699 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.434983 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.435267 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.435544 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.435821 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.449880 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.450167 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.452252 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.452557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.454023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.456440 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.457249 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.457546 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.459482 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.459888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.461733 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.464581 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.464986 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.467704 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.468171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.468510 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.468800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.469093 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.469375 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.469657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.470831 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.471134 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.471422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.471813 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.472096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.472409 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.485608 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.485853 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.486127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.486392 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.488536 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.488828 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.489097 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.489361 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.493249 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.495320 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.496890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.497051 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.497168 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.498703 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.499783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.500079 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.500232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.500396 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.500538 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.500681 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.501071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.503159 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.503442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.503731 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.504020 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.504318 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.512210 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.512523 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.512812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.513098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.513481 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.513766 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.514049 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.516106 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.516414 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.516695 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.516975 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.517257 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.517533 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.517808 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.529447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.532377 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.533665 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.535243 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.536692 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.536777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.538169 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.538456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.538852 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.539560 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.541049 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.543675 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.543961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.544245 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.546071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.547534 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.550539 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.550700 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.550934 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.551225 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.551529 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.552182 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.555060 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.555353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.555640 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.555919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.559396 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.559707 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.559993 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.564421 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.564717 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.565002 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.567745 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.568032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.568342 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.568623 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.568900 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.569186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.569471 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.569752 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.570033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.570305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.570577 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.570858 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.571124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.571390 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.572749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 19:04:46.573993 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.574282 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.574561 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.574845 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.575128 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.575412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.575682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.575972 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.576243 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.576539 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.576811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.577077 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.577347 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 19:04:46.605671 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55da72e7c9c0 pid: 88307 (default app) Oct 20 19:04:46.608957 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd1189-dee7-45f7-a20c-cb9203aa5704 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:04:46.609245 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd1189-dee7-45f7-a20c-cb9203aa5704 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:04:46.609514 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd1189-dee7-45f7-a20c-cb9203aa5704 None None] PATH_INFO: `/v3` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:04:46.611549 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55da72e7c9c0 pid: 88308 (default app) Oct 20 19:04:46.613675 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Thu Oct 20 19:04:46 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:04:53.816773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce6ed7-3b71-43e0-9a11-c05f3daca1e3 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:04:53.817328 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce6ed7-3b71-43e0-9a11-c05f3daca1e3 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:04:53.817328 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce6ed7-3b71-43e0-9a11-c05f3daca1e3 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:04:53.821494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:04:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:04:53.826688 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6180e-23af-4bbb-b012-376210fac86d None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:04:53.827278 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6180e-23af-4bbb-b012-376210fac86d None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:04:53.827278 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6180e-23af-4bbb-b012-376210fac86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:04:53.904079 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: INFO dbcounter [None req-51f6180e-23af-4bbb-b012-376210fac86d None None] Registered counter for database keystone Oct 20 19:04:53.924159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG oslo_db.sqlalchemy.engines [None req-51f6180e-23af-4bbb-b012-376210fac86d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 20 19:04:53.930375 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writer thread running {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 19:04:54.107469 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG passlib.handlers.bcrypt [None req-51f6180e-23af-4bbb-b012-376210fac86d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88307) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 20 19:04:54.107808 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG passlib.handlers.bcrypt [None req-51f6180e-23af-4bbb-b012-376210fac86d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88307) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 20 19:04:54.166238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-51f6180e-23af-4bbb-b012-376210fac86d None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:04:54.168119 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-51f6180e-23af-4bbb-b012-376210fac86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:04:54.294072 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:04:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 19:04:54.798287 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce6ed7-3b71-43e0-9a11-c05f3daca1e3 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:04:54.872438 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: INFO dbcounter [None req-22ce6ed7-3b71-43e0-9a11-c05f3daca1e3 None None] Registered counter for database keystone Oct 20 19:04:54.893297 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG oslo_db.sqlalchemy.engines [None req-22ce6ed7-3b71-43e0-9a11-c05f3daca1e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88308) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 20 19:04:54.899342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writer thread running {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 19:04:55.015649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce6ed7-3b71-43e0-9a11-c05f3daca1e3 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:04:55.019801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30adacb0-a1bf-4e89-ad01-c69d65593eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:04:55.020442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adacb0-a1bf-4e89-ad01-c69d65593eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:04:55.020716 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adacb0-a1bf-4e89-ad01-c69d65593eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:04:55.020980 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30adacb0-a1bf-4e89-ad01-c69d65593eb0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:04:55.029212 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adacb0-a1bf-4e89-ad01-c69d65593eb0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:04:55.081066 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: WARNING keystone.common.rbac_enforcer.enforcer [None req-30adacb0-a1bf-4e89-ad01-c69d65593eb0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 20 19:04:55.081407 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30adacb0-a1bf-4e89-ad01-c69d65593eb0 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:04:55.091067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Oct 20 19:04:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 19:04:55.097122 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6180e-23af-4bbb-b012-376210fac86d None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:04:55.114302 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6180e-23af-4bbb-b012-376210fac86d None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:04:55.118730 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364ac0e-23c7-45ad-92ed-7e4946c5a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:04:55.120644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364ac0e-23c7-45ad-92ed-7e4946c5a868 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:04:55.120927 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364ac0e-23c7-45ad-92ed-7e4946c5a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:04:55.121196 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364ac0e-23c7-45ad-92ed-7e4946c5a868 admin admin] PATH_INFO: `/v3/projects/fb75e3ae7a47470dbe383104be65755f` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:04:55.125141 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364ac0e-23c7-45ad-92ed-7e4946c5a868 admin admin] RBAC: Authorizing `identity:get_project(project_id=fb75e3ae7a47470dbe383104be65755f)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:04:55.176367 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1364ac0e-23c7-45ad-92ed-7e4946c5a868 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 20 19:04:55.176712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364ac0e-23c7-45ad-92ed-7e4946c5a868 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:04:55.181155 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 19:04:55 2022] GET /identity/v3/projects/fb75e3ae7a47470dbe383104be65755f => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:04:57.551784 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e289-3cd8-4afe-942c-e91db01caa9b None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:04:57.552370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e289-3cd8-4afe-942c-e91db01caa9b None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:04:57.552370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e289-3cd8-4afe-942c-e91db01caa9b None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:04:57.556389 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:04:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:04:57.562238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121e36-d44a-422f-8975-d142eeebcf16 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:04:57.562658 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121e36-d44a-422f-8975-d142eeebcf16 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:04:57.562789 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121e36-d44a-422f-8975-d142eeebcf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:04:57.583122 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-88121e36-d44a-422f-8975-d142eeebcf16 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:04:57.584649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-88121e36-d44a-422f-8975-d142eeebcf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:04:57.592691 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:04:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 19:04:57.913319 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e289-3cd8-4afe-942c-e91db01caa9b None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:04:57.926003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e289-3cd8-4afe-942c-e91db01caa9b None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:04:57.930193 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7c9bb-8439-48f1-a90c-dfc31edc26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:04:57.930781 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7c9bb-8439-48f1-a90c-dfc31edc26d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:04:57.931054 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7c9bb-8439-48f1-a90c-dfc31edc26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:04:57.931320 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7c9bb-8439-48f1-a90c-dfc31edc26d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:04:57.938806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7c9bb-8439-48f1-a90c-dfc31edc26d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:04:57.940580 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7c9bb-8439-48f1-a90c-dfc31edc26d5 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:04:57.949832 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Oct 20 19:04:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 19:04:57.954973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88121e36-d44a-422f-8975-d142eeebcf16 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:04:57.964648 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88121e36-d44a-422f-8975-d142eeebcf16 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:04:57.968982 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ed990-12e4-4785-b29a-8f86420692f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:04:57.969592 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ed990-12e4-4785-b29a-8f86420692f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:04:57.969868 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ed990-12e4-4785-b29a-8f86420692f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:04:57.970138 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ed990-12e4-4785-b29a-8f86420692f4 admin admin] PATH_INFO: `/v3/users/cc589496feb245fc97089364fc0bb055` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:04:57.971439 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ed990-12e4-4785-b29a-8f86420692f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc589496feb245fc97089364fc0bb055)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:04:57.973274 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ed990-12e4-4785-b29a-8f86420692f4 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:04:57.974769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Oct 20 19:04:57 2022] GET /identity/v3/users/cc589496feb245fc97089364fc0bb055 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:00.402310 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb915c-8a6f-4cc9-8321-a6060b4ac513 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:00.402878 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb915c-8a6f-4cc9-8321-a6060b4ac513 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:00.402878 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb915c-8a6f-4cc9-8321-a6060b4ac513 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:00.404135 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:05:00.409608 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee028398-1663-4a15-9ef2-697eee7221da None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:00.410037 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee028398-1663-4a15-9ef2-697eee7221da None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:00.410297 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee028398-1663-4a15-9ef2-697eee7221da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:00.429421 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-ee028398-1663-4a15-9ef2-697eee7221da None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:00.430599 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-ee028398-1663-4a15-9ef2-697eee7221da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:00.459297 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416613f3-ca67-4939-a5e2-387328bf0eb3 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:00.459574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416613f3-ca67-4939-a5e2-387328bf0eb3 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:00.459847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416613f3-ca67-4939-a5e2-387328bf0eb3 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:00.461208 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:05:00.466773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224b08-0094-46a4-a66b-19d79b708dac None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:00.467051 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224b08-0094-46a4-a66b-19d79b708dac None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:00.467317 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224b08-0094-46a4-a66b-19d79b708dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:00.508696 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG passlib.handlers.bcrypt [None req-62224b08-0094-46a4-a66b-19d79b708dac None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88308) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 20 19:05:00.509111 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG passlib.handlers.bcrypt [None req-62224b08-0094-46a4-a66b-19d79b708dac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88308) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 20 19:05:00.514236 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:00.559546 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-62224b08-0094-46a4-a66b-19d79b708dac None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:00.561176 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-62224b08-0094-46a4-a66b-19d79b708dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:00.659719 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 19:05:00.836106 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee028398-1663-4a15-9ef2-697eee7221da None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:00.969779 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:00.979352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62224b08-0094-46a4-a66b-19d79b708dac None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:01.049765 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee028398-1663-4a15-9ef2-697eee7221da None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:01.082119 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62224b08-0094-46a4-a66b-19d79b708dac None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:01.083604 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2311587-60f2-4623-b556-62c74ee61693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:01.084292 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2311587-60f2-4623-b556-62c74ee61693 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:01.084585 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2311587-60f2-4623-b556-62c74ee61693 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:01.084859 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2311587-60f2-4623-b556-62c74ee61693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:01.085250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:01.096009 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2311587-60f2-4623-b556-62c74ee61693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-d2311587-60f2-4623-b556-62c74ee61693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:01.105517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:01.106657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:01.107644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 19:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:05:01.112645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2311587-60f2-4623-b556-62c74ee61693 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:01.124251 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9860d-5be0-47e3-8375-af7f60c15596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:01.125473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9860d-5be0-47e3-8375-af7f60c15596 None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:01.125765 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9860d-5be0-47e3-8375-af7f60c15596 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:01.126037 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9860d-5be0-47e3-8375-af7f60c15596 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:01.127010 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9860d-5be0-47e3-8375-af7f60c15596 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:01.128621 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9860d-5be0-47e3-8375-af7f60c15596 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:01.140220 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.sql.core [None req-4fb9860d-5be0-47e3-8375-af7f60c15596 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 19:05:01.140220 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 19:05:01.140220 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [parameters: {'id': '92178749d99a4e78a08292c4126dcdd0', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 19:05:01.140220 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88308) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-4fb9860d-5be0-47e3-8375-af7f60c15596 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application conn.query(q) Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 19:05:01.158888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application result.read() Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 19:05:01.159811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application next(self.gen) Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application yield resource Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application next(self.gen) Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise self.value Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application session.commit() Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 19:05:01.160773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self.session.flush() Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application compat.raise_( Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 19:05:01.161608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 19:05:01.162473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application conn.query(q) Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application result.read() Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 19:05:01.163224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [parameters: {'id': '92178749d99a4e78a08292c4126dcdd0', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 19:05:01.163999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:01.165342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:01.167523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 8/15] 10.222.0.16 () {60 vars in 1137 bytes} [Thu Oct 20 19:05:00 2022] POST /identity/v3/domains => generated 190 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:05:01.171327 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9860d-5be0-47e3-8375-af7f60c15596 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:01.194792 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:01.213675 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2311587-60f2-4623-b556-62c74ee61693 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:01.247004 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485ddcf-7155-43c8-b14b-c587e4ad6295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:01.247537 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485ddcf-7155-43c8-b14b-c587e4ad6295 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:01.247807 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485ddcf-7155-43c8-b14b-c587e4ad6295 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:01.248067 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485ddcf-7155-43c8-b14b-c587e4ad6295 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:01.248755 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485ddcf-7155-43c8-b14b-c587e4ad6295 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:01.249054 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485ddcf-7155-43c8-b14b-c587e4ad6295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:01.250418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485ddcf-7155-43c8-b14b-c587e4ad6295 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:01.261964 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 8/16] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:01.267413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485ddcf-7155-43c8-b14b-c587e4ad6295 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:01.277237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9860d-5be0-47e3-8375-af7f60c15596 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:01.311125 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14db42-604d-45ef-b5d2-6d05af1f3150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:01.311965 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14db42-604d-45ef-b5d2-6d05af1f3150 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:01.312237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14db42-604d-45ef-b5d2-6d05af1f3150 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:01.312541 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14db42-604d-45ef-b5d2-6d05af1f3150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:01.330027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14db42-604d-45ef-b5d2-6d05af1f3150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:01.331469 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14db42-604d-45ef-b5d2-6d05af1f3150 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-fd14db42-604d-45ef-b5d2-6d05af1f3150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:05:01.352108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:01.353241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:05:01.358637 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:05:01.358637 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:05:01.358637 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:01.358637 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:01.359764 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14db42-604d-45ef-b5d2-6d05af1f3150 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:01.368291 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485ddcf-7155-43c8-b14b-c587e4ad6295 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:01.404840 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0775e-a4bc-4c95-970c-2ef2bb70b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:01.405504 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0775e-a4bc-4c95-970c-2ef2bb70b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:01.405783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0775e-a4bc-4c95-970c-2ef2bb70b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:01.406070 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0775e-a4bc-4c95-970c-2ef2bb70b3f9 None admin] PATH_INFO: `/v3/users/cc589496feb245fc97089364fc0bb055` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:01.407267 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0775e-a4bc-4c95-970c-2ef2bb70b3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=cc589496feb245fc97089364fc0bb055)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:01.408804 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0775e-a4bc-4c95-970c-2ef2bb70b3f9 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:01.410438 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:01 2022] GET /identity/v3/users/cc589496feb245fc97089364fc0bb055 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:01.416774 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0775e-a4bc-4c95-970c-2ef2bb70b3f9 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:01.433665 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:01.490357 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:01.524644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0775e-a4bc-4c95-970c-2ef2bb70b3f9 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:01.559513 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623b441-93c4-4d1b-8417-9b2f9c755b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:01.560136 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623b441-93c4-4d1b-8417-9b2f9c755b31 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:01.560447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623b441-93c4-4d1b-8417-9b2f9c755b31 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:01.560718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623b441-93c4-4d1b-8417-9b2f9c755b31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:01.561829 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623b441-93c4-4d1b-8417-9b2f9c755b31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:01.563270 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623b441-93c4-4d1b-8417-9b2f9c755b31 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:01.564841 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:01.570353 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623b441-93c4-4d1b-8417-9b2f9c755b31 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:01.572973 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14db42-604d-45ef-b5d2-6d05af1f3150 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:01.607227 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00f846-8d1f-41f5-bcc1-489363b34e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:01.607821 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00f846-8d1f-41f5-bcc1-489363b34e03 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:01.608094 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00f846-8d1f-41f5-bcc1-489363b34e03 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:01.608430 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00f846-8d1f-41f5-bcc1-489363b34e03 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:01.609061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00f846-8d1f-41f5-bcc1-489363b34e03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:01.609357 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00f846-8d1f-41f5-bcc1-489363b34e03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:01.611006 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00f846-8d1f-41f5-bcc1-489363b34e03 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:01.627826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:01.650125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:01.672219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623b441-93c4-4d1b-8417-9b2f9c755b31 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:01.711620 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0ca36-c306-4d8a-8910-f442bcd13bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:01.712327 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0ca36-c306-4d8a-8910-f442bcd13bf9 None admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:01.712610 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0ca36-c306-4d8a-8910-f442bcd13bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:01.712893 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0ca36-c306-4d8a-8910-f442bcd13bf9 None admin] PATH_INFO: `/v3/domains/default/users/cc589496feb245fc97089364fc0bb055/roles/fde247f30afe4b81958b67c776cabec0` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:01.715632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0ca36-c306-4d8a-8910-f442bcd13bf9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cc589496feb245fc97089364fc0bb055, role_id=fde247f30afe4b81958b67c776cabec0)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:01.717138 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0ca36-c306-4d8a-8910-f442bcd13bf9 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:01.840561 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1361 bytes} [Thu Oct 20 19:05:01 2022] PUT /identity/v3/domains/default/users/cc589496feb245fc97089364fc0bb055/roles/fde247f30afe4b81958b67c776cabec0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 19:05:04.669954 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561f8a9-fa82-441f-bb15-e665a7a76e13 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:04.670509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561f8a9-fa82-441f-bb15-e665a7a76e13 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:04.670509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561f8a9-fa82-441f-bb15-e665a7a76e13 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:04.671797 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:04.677852 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1f84-079f-4227-8257-b334f0be0d4e None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:04.678662 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1f84-079f-4227-8257-b334f0be0d4e None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:04.679171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1f84-079f-4227-8257-b334f0be0d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:04.715884 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-675d1f84-079f-4227-8257-b334f0be0d4e None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:04.717818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-675d1f84-079f-4227-8257-b334f0be0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:04.805907 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:05.020113 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e28a2-1387-4a20-a1e3-61dc3e148707 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:05.020836 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e28a2-1387-4a20-a1e3-61dc3e148707 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:05.021318 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e28a2-1387-4a20-a1e3-61dc3e148707 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:05.022843 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:05.028597 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede009af-563d-4f52-90d6-45ec8e929b9d None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:05.029105 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede009af-563d-4f52-90d6-45ec8e929b9d None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:05.029619 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede009af-563d-4f52-90d6-45ec8e929b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:05.054540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-ede009af-563d-4f52-90d6-45ec8e929b9d None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:05.056082 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-ede009af-563d-4f52-90d6-45ec8e929b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:05.133680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:05.138995 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:05.156037 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3459a-29f7-489e-a31a-16a6676058a0 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:05.156374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3459a-29f7-489e-a31a-16a6676058a0 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:05.156627 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3459a-29f7-489e-a31a-16a6676058a0 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:05.158118 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 13/26] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:05.163658 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb693842-d8bc-4f13-8ed4-7a511993dd4b None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:05.163955 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb693842-d8bc-4f13-8ed4-7a511993dd4b None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:05.164238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb693842-d8bc-4f13-8ed4-7a511993dd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:05.189311 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-cb693842-d8bc-4f13-8ed4-7a511993dd4b None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:05.190523 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-cb693842-d8bc-4f13-8ed4-7a511993dd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:05.289069 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:05.333362 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401ef3-a21f-44a8-bdcd-9065fdb20c02 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:05.333689 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401ef3-a21f-44a8-bdcd-9065fdb20c02 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:05.333920 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401ef3-a21f-44a8-bdcd-9065fdb20c02 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:05.335266 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 14/28] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:05.346387 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e42d4-0e67-4ec8-983f-00d522d7bec8 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:05.346712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e42d4-0e67-4ec8-983f-00d522d7bec8 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:05.346938 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e42d4-0e67-4ec8-983f-00d522d7bec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:05.377383 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-704e42d4-0e67-4ec8-983f-00d522d7bec8 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:05.378590 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-704e42d4-0e67-4ec8-983f-00d522d7bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:05.467527 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:05.521260 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c401ef3-a21f-44a8-bdcd-9065fdb20c02 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:05.631082 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e42d4-0e67-4ec8-983f-00d522d7bec8 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:05.644713 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:05.674381 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c401ef3-a21f-44a8-bdcd-9065fdb20c02 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:05.748662 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:05.758819 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cfa89-80e6-4d73-9ebf-db360d4118b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:05.759494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfa89-80e6-4d73-9ebf-db360d4118b8 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:05.760470 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfa89-80e6-4d73-9ebf-db360d4118b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:05.760952 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cfa89-80e6-4d73-9ebf-db360d4118b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:05.792630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cfa89-80e6-4d73-9ebf-db360d4118b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:05.794107 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cfa89-80e6-4d73-9ebf-db360d4118b8 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-8d7cfa89-80e6-4d73-9ebf-db360d4118b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:05:05.821825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:05.822936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:05:05.823810 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:05:05.823810 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:05:05.823810 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:05.823810 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 15/30] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:05.823810 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fc395-08d8-49da-a9c9-f8ca05f06a48 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:05.824068 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fc395-08d8-49da-a9c9-f8ca05f06a48 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:05.824693 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fc395-08d8-49da-a9c9-f8ca05f06a48 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:05.825804 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 16/31] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:05.831024 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fc395-08d8-49da-a9c9-f8ca05f06a48 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:05.856343 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e42d4-0e67-4ec8-983f-00d522d7bec8 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:05.919383 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63543707-aff8-44d4-9cf1-4ff9b2ca0740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:05.920332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63543707-aff8-44d4-9cf1-4ff9b2ca0740 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:05.920845 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63543707-aff8-44d4-9cf1-4ff9b2ca0740 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:05.921347 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63543707-aff8-44d4-9cf1-4ff9b2ca0740 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:05.922262 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63543707-aff8-44d4-9cf1-4ff9b2ca0740 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:05.924043 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63543707-aff8-44d4-9cf1-4ff9b2ca0740 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:05.949149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 16/32] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Oct 20 19:05:05 2022] POST /identity/v3/roles => generated 225 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:05.950700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d3a22-6258-49ca-8459-303c6041377b None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:05.951101 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d3a22-6258-49ca-8459-303c6041377b None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:05.951473 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d3a22-6258-49ca-8459-303c6041377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:05.971147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-9a9d3a22-6258-49ca-8459-303c6041377b None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:05.972520 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-9a9d3a22-6258-49ca-8459-303c6041377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:05.978021 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fc395-08d8-49da-a9c9-f8ca05f06a48 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:06.018907 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:06.024776 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8229c-925c-4392-b11c-0ecfc3ec9a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:06.026721 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8229c-925c-4392-b11c-0ecfc3ec9a51 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:06.026721 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8229c-925c-4392-b11c-0ecfc3ec9a51 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:06.026901 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8229c-925c-4392-b11c-0ecfc3ec9a51 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:06.027530 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8229c-925c-4392-b11c-0ecfc3ec9a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:06.028192 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8229c-925c-4392-b11c-0ecfc3ec9a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:06.030414 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8229c-925c-4392-b11c-0ecfc3ec9a51 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:06.046933 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 17/33] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:06.053262 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8229c-925c-4392-b11c-0ecfc3ec9a51 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:06.062904 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 17/34] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:06.064190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d3a22-6258-49ca-8459-303c6041377b None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:06.124668 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:06.165572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8229c-925c-4392-b11c-0ecfc3ec9a51 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:06.203697 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ed7e0-0b27-48bf-9fbf-929e627ff43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:06.204393 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ed7e0-0b27-48bf-9fbf-929e627ff43f None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:06.204676 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ed7e0-0b27-48bf-9fbf-929e627ff43f None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:06.204948 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ed7e0-0b27-48bf-9fbf-929e627ff43f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:06.219092 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ed7e0-0b27-48bf-9fbf-929e627ff43f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-078ed7e0-0b27-48bf-9fbf-929e627ff43f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:06.225694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:06.226641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:06.227412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 18/35] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 19:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:06.228041 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ed7e0-0b27-48bf-9fbf-929e627ff43f None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:06.230635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d3a22-6258-49ca-8459-303c6041377b None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:06.297698 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:06.306020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ccb9d-e9fd-45d8-9166-b2e10bf1634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:06.307461 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ccb9d-e9fd-45d8-9166-b2e10bf1634c None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:06.308298 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ccb9d-e9fd-45d8-9166-b2e10bf1634c None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:06.309148 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ccb9d-e9fd-45d8-9166-b2e10bf1634c None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:06.310022 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ccb9d-e9fd-45d8-9166-b2e10bf1634c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:06.312015 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ccb9d-e9fd-45d8-9166-b2e10bf1634c None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:06.336615 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 18/36] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Oct 20 19:05:06 2022] POST /identity/v3/roles => generated 219 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:06.342395 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ccb9d-e9fd-45d8-9166-b2e10bf1634c None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:06.356690 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ed7e0-0b27-48bf-9fbf-929e627ff43f None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:06.427482 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148642c-01a2-4b42-ab31-d1b5ed6b881c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:06.428499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148642c-01a2-4b42-ab31-d1b5ed6b881c None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:06.428977 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148642c-01a2-4b42-ab31-d1b5ed6b881c None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:06.429464 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148642c-01a2-4b42-ab31-d1b5ed6b881c None admin] PATH_INFO: `/v3/projects` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:06.430311 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148642c-01a2-4b42-ab31-d1b5ed6b881c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:06.432559 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148642c-01a2-4b42-ab31-d1b5ed6b881c None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:06.538310 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ccb9d-e9fd-45d8-9166-b2e10bf1634c None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:06.555533 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:06.584842 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f296-37f3-4f06-9261-ac4ada02411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:06.585472 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f296-37f3-4f06-9261-ac4ada02411f None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:06.585754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f296-37f3-4f06-9261-ac4ada02411f None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:06.586028 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9f296-37f3-4f06-9261-ac4ada02411f None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:06.586709 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9f296-37f3-4f06-9261-ac4ada02411f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:06.587018 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9f296-37f3-4f06-9261-ac4ada02411f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:06.589168 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9f296-37f3-4f06-9261-ac4ada02411f None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:06.598771 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 19/37] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:06.599479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f296-37f3-4f06-9261-ac4ada02411f None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:06.608332 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 19/38] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 19:05:06 2022] POST /identity/v3/projects => generated 301 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:06.608332 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ce7d1-4147-47d4-a6da-05492d43cb8a None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:06.608332 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ce7d1-4147-47d4-a6da-05492d43cb8a None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:06.608332 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ce7d1-4147-47d4-a6da-05492d43cb8a None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:06.608332 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 20/39] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:06.608332 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ce7d1-4147-47d4-a6da-05492d43cb8a None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:06.744998 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9f296-37f3-4f06-9261-ac4ada02411f None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:06.754873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ce7d1-4147-47d4-a6da-05492d43cb8a None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:06.757491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:06.789150 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb2c7-f971-42eb-a754-7551838b7804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:06.789683 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb2c7-f971-42eb-a754-7551838b7804 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:06.790222 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb2c7-f971-42eb-a754-7551838b7804 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:06.790501 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeb2c7-f971-42eb-a754-7551838b7804 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:06.792497 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeb2c7-f971-42eb-a754-7551838b7804 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:06.794455 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeb2c7-f971-42eb-a754-7551838b7804 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:06.800021 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64eb7e-af9f-4f8e-801e-fe65ceebc604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:06.800248 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64eb7e-af9f-4f8e-801e-fe65ceebc604 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:06.800536 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64eb7e-af9f-4f8e-801e-fe65ceebc604 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:06.800807 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64eb7e-af9f-4f8e-801e-fe65ceebc604 None admin] PATH_INFO: `/v3/users/cc589496feb245fc97089364fc0bb055` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:06.802585 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64eb7e-af9f-4f8e-801e-fe65ceebc604 None admin] RBAC: Authorizing `identity:get_user(user_id=cc589496feb245fc97089364fc0bb055)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:06.804669 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64eb7e-af9f-4f8e-801e-fe65ceebc604 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:06.811545 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 21/40] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:06 2022] GET /identity/v3/users/cc589496feb245fc97089364fc0bb055 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:06.811545 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cbc27-c3a3-4212-a7d7-fcc42baccc21 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:06.811545 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cbc27-c3a3-4212-a7d7-fcc42baccc21 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:06.811545 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cbc27-c3a3-4212-a7d7-fcc42baccc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:06.815190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Oct 20 19:05:06 2022] POST /identity/v3/roles => generated 223 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:06.817823 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb2c7-f971-42eb-a754-7551838b7804 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:06.829595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-ce4cbc27-c3a3-4212-a7d7-fcc42baccc21 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:06.831345 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-ce4cbc27-c3a3-4212-a7d7-fcc42baccc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:06.865116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:06.930647 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:06.954849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeb2c7-f971-42eb-a754-7551838b7804 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:06.991918 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4a144-0c7c-41d4-a600-94091c2135e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:06.992616 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4a144-0c7c-41d4-a600-94091c2135e6 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:06.992898 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4a144-0c7c-41d4-a600-94091c2135e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:06.993173 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4a144-0c7c-41d4-a600-94091c2135e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:06.994970 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4a144-0c7c-41d4-a600-94091c2135e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:06.996486 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4a144-0c7c-41d4-a600-94091c2135e6 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:06.998319 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:07.004176 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cbc27-c3a3-4212-a7d7-fcc42baccc21 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:07.110647 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cbc27-c3a3-4212-a7d7-fcc42baccc21 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:07.112308 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:07.146284 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070b031-f00b-491a-b64f-96dfeed55009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:07.146896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b031-f00b-491a-b64f-96dfeed55009 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:07.147177 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b031-f00b-491a-b64f-96dfeed55009 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:07.147448 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070b031-f00b-491a-b64f-96dfeed55009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:07.148169 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070b031-f00b-491a-b64f-96dfeed55009 None admin] RBAC: Adding query filter params (role.id=fde247f30afe4b81958b67c776cabec0, scope.domain.id=default, user.id=cc589496feb245fc97089364fc0bb055) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:07.148511 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070b031-f00b-491a-b64f-96dfeed55009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:07.149947 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070b031-f00b-491a-b64f-96dfeed55009 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:07.158259 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 23/44] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Oct 20 19:05:07 2022] GET /identity/v3/role_assignments?user.id=cc589496feb245fc97089364fc0bb055&scope.domain.id=default&role.id=fde247f30afe4b81958b67c776cabec0 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:07.253623 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4a144-0c7c-41d4-a600-94091c2135e6 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:07.356607 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:07.359522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4a144-0c7c-41d4-a600-94091c2135e6 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:07.395538 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591191e-905e-4949-bd47-f619808e7e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:07.396095 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591191e-905e-4949-bd47-f619808e7e92 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:07.396406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591191e-905e-4949-bd47-f619808e7e92 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:07.396679 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591191e-905e-4949-bd47-f619808e7e92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:07.397785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591191e-905e-4949-bd47-f619808e7e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:07.399235 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591191e-905e-4949-bd47-f619808e7e92 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:07.401051 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:07.406642 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070b031-f00b-491a-b64f-96dfeed55009 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:07.505636 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070b031-f00b-491a-b64f-96dfeed55009 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:07.538351 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c6487-e5de-4b1e-9c36-37a4796d1c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:07.538949 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c6487-e5de-4b1e-9c36-37a4796d1c91 None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:07.539228 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c6487-e5de-4b1e-9c36-37a4796d1c91 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:07.539498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c6487-e5de-4b1e-9c36-37a4796d1c91 None admin] PATH_INFO: `/v3/projects` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:07.540140 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c6487-e5de-4b1e-9c36-37a4796d1c91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:07.542580 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c6487-e5de-4b1e-9c36-37a4796d1c91 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:07.567986 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 19:05:07 2022] POST /identity/v3/projects => generated 312 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:09.996946 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ada09-08d2-472a-9f66-3ba8a7f4b210 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:09.997435 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ada09-08d2-472a-9f66-3ba8a7f4b210 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:09.997435 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ada09-08d2-472a-9f66-3ba8a7f4b210 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:09.998767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:10.004300 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e36f9-e56d-4c28-a71f-bd368184c444 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:10.004668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e36f9-e56d-4c28-a71f-bd368184c444 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:10.004851 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e36f9-e56d-4c28-a71f-bd368184c444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:10.023233 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-988e36f9-e56d-4c28-a71f-bd368184c444 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:10.024448 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-988e36f9-e56d-4c28-a71f-bd368184c444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:10.037652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:10.090238 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:10.410891 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ada09-08d2-472a-9f66-3ba8a7f4b210 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:10.512558 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ada09-08d2-472a-9f66-3ba8a7f4b210 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:10.546270 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c95ac-4035-407d-b34f-2537479444be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:10.546885 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c95ac-4035-407d-b34f-2537479444be None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:10.547162 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c95ac-4035-407d-b34f-2537479444be None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:10.547431 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c95ac-4035-407d-b34f-2537479444be None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:10.548554 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c95ac-4035-407d-b34f-2537479444be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:10.549997 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c95ac-4035-407d-b34f-2537479444be None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:10.551533 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:10.557259 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e36f9-e56d-4c28-a71f-bd368184c444 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:10.651257 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e36f9-e56d-4c28-a71f-bd368184c444 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:10.682968 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225e707-91e9-4476-be31-5e7541f4924e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:10.683570 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e707-91e9-4476-be31-5e7541f4924e None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:10.683844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e707-91e9-4476-be31-5e7541f4924e None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:10.684112 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225e707-91e9-4476-be31-5e7541f4924e None admin] PATH_INFO: `/v3/projects` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:10.684776 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225e707-91e9-4476-be31-5e7541f4924e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:10.686200 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225e707-91e9-4476-be31-5e7541f4924e None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:10.706680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:10.713676 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Oct 20 19:05:10 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:13.079550 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe53f8-e193-4998-8346-e63be013bb9c None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:13.080038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe53f8-e193-4998-8346-e63be013bb9c None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:13.080038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe53f8-e193-4998-8346-e63be013bb9c None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:13.081393 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 25/51] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:13.086548 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355128fa-8d5d-4590-a23e-c17c7f6da92f None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:13.086955 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355128fa-8d5d-4590-a23e-c17c7f6da92f None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:13.087098 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355128fa-8d5d-4590-a23e-c17c7f6da92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:13.105725 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-355128fa-8d5d-4590-a23e-c17c7f6da92f None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:13.106901 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-355128fa-8d5d-4590-a23e-c17c7f6da92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:13.172063 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:13.494398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe53f8-e193-4998-8346-e63be013bb9c None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:13.529695 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:13.592426 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe53f8-e193-4998-8346-e63be013bb9c None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:13.624780 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cd195-15b7-4743-81ae-46fed8722389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:13.625392 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cd195-15b7-4743-81ae-46fed8722389 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:13.625671 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cd195-15b7-4743-81ae-46fed8722389 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:13.625953 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cd195-15b7-4743-81ae-46fed8722389 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:13.627058 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cd195-15b7-4743-81ae-46fed8722389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:13.628516 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cd195-15b7-4743-81ae-46fed8722389 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:13.630052 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:13.635998 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355128fa-8d5d-4590-a23e-c17c7f6da92f None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:13.734788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355128fa-8d5d-4590-a23e-c17c7f6da92f None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:13.762215 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:13.768233 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9454236-7f96-4c94-b125-b828f4fe657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:13.768867 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454236-7f96-4c94-b125-b828f4fe657e None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:13.769156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454236-7f96-4c94-b125-b828f4fe657e None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:13.769433 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454236-7f96-4c94-b125-b828f4fe657e None admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:13.770083 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9454236-7f96-4c94-b125-b828f4fe657e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:13.771511 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9454236-7f96-4c94-b125-b828f4fe657e None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:13.797981 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 28/54] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:05:13 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 19:05:17.241955 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304336db-d317-4495-b026-43767e9180c3 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:17.242960 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304336db-d317-4495-b026-43767e9180c3 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:17.243992 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304336db-d317-4495-b026-43767e9180c3 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:17.245635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 27/55] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:17.250824 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2b68b-c8d0-4a96-a142-bc0d08f0a71e None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:17.251642 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2b68b-c8d0-4a96-a142-bc0d08f0a71e None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:17.252116 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2b68b-c8d0-4a96-a142-bc0d08f0a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:17.281302 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-69e2b68b-c8d0-4a96-a142-bc0d08f0a71e None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:17.282830 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-69e2b68b-c8d0-4a96-a142-bc0d08f0a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:17.378504 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 29/56] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:17.540245 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75fe11-3d93-49b0-b866-efd40cb0190e None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:17.541542 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75fe11-3d93-49b0-b866-efd40cb0190e None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:17.542314 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75fe11-3d93-49b0-b866-efd40cb0190e None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:17.544043 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 28/57] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:17.549972 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a946-0b33-489b-9ef9-8f0a017619d3 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:17.550526 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a946-0b33-489b-9ef9-8f0a017619d3 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:17.551047 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a946-0b33-489b-9ef9-8f0a017619d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:17.581351 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-0a53a946-0b33-489b-9ef9-8f0a017619d3 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:17.582974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-0a53a946-0b33-489b-9ef9-8f0a017619d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:17.668338 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 30/58] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:17.744830 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75fe11-3d93-49b0-b866-efd40cb0190e None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:17.789797 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e57f-6748-49c2-8984-755be91e3b65 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:17.791678 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e57f-6748-49c2-8984-755be91e3b65 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:17.791911 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e57f-6748-49c2-8984-755be91e3b65 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:17.794188 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 31/59] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:17.799721 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabb276-8939-4755-a0b9-6d1aebb22b56 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:17.800004 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabb276-8939-4755-a0b9-6d1aebb22b56 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:17.800352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabb276-8939-4755-a0b9-6d1aebb22b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:17.832887 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-acabb276-8939-4755-a0b9-6d1aebb22b56 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:17.834087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-acabb276-8939-4755-a0b9-6d1aebb22b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:17.902991 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:17.919192 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75fe11-3d93-49b0-b866-efd40cb0190e None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:17.924178 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:17.933123 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 32/60] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:17.963837 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6d972-e95f-4e3c-855a-304f3b14fa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:17.964556 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6d972-e95f-4e3c-855a-304f3b14fa44 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:17.964941 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6d972-e95f-4e3c-855a-304f3b14fa44 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:17.965217 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6d972-e95f-4e3c-855a-304f3b14fa44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:17.975980 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6d972-e95f-4e3c-855a-304f3b14fa44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-bfd6d972-e95f-4e3c-855a-304f3b14fa44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:17.981001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:17.981870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:17.982661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 29/61] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:17.988207 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabb276-8939-4755-a0b9-6d1aebb22b56 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:18.059196 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6d972-e95f-4e3c-855a-304f3b14fa44 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:18.160126 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabb276-8939-4755-a0b9-6d1aebb22b56 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:18.202214 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0c1fa-3e03-4936-b1f6-a684aab48c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:18.202828 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0c1fa-3e03-4936-b1f6-a684aab48c20 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.203107 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0c1fa-3e03-4936-b1f6-a684aab48c20 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.203378 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0c1fa-3e03-4936-b1f6-a684aab48c20 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.204044 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0c1fa-3e03-4936-b1f6-a684aab48c20 None admin] RBAC: Adding query filter params (name=member) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:18.204383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0c1fa-3e03-4936-b1f6-a684aab48c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:18.205773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0c1fa-3e03-4936-b1f6-a684aab48c20 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:18.207417 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6d972-e95f-4e3c-855a-304f3b14fa44 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:18.217988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 33/62] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:18.219253 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bb62e-7b49-44cd-a37a-520e153bd0b7 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.219539 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bb62e-7b49-44cd-a37a-520e153bd0b7 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.219816 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bb62e-7b49-44cd-a37a-520e153bd0b7 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.221099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 34/63] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:18.222115 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb05dc-370b-46d0-b02d-8ef250e0a841 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.226330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb05dc-370b-46d0-b02d-8ef250e0a841 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.226330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb05dc-370b-46d0-b02d-8ef250e0a841 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.226330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 35/64] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:18.226330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb05dc-370b-46d0-b02d-8ef250e0a841 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:18.252921 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d5fcf-34bd-47c6-a3c7-24e940482752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:18.253585 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d5fcf-34bd-47c6-a3c7-24e940482752 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.253851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d5fcf-34bd-47c6-a3c7-24e940482752 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.254106 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d5fcf-34bd-47c6-a3c7-24e940482752 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.265203 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d5fcf-34bd-47c6-a3c7-24e940482752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-079d5fcf-34bd-47c6-a3c7-24e940482752 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:18.269334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:18.270149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:18.270943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 30/65] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 19:05:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:05:18.271588 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf68cd-a90b-41ad-9492-c5069a5d228c None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.272649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf68cd-a90b-41ad-9492-c5069a5d228c None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.272649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf68cd-a90b-41ad-9492-c5069a5d228c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.273221 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:18.291312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-84cf68cd-a90b-41ad-9492-c5069a5d228c None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:18.292595 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-84cf68cd-a90b-41ad-9492-c5069a5d228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:18.310571 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:18.340374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb05dc-370b-46d0-b02d-8ef250e0a841 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:18.372296 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 31/66] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:18.372296 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd614-4e5d-4e96-b8bd-bea1a74664ac None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.372296 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd614-4e5d-4e96-b8bd-bea1a74664ac None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.372296 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd614-4e5d-4e96-b8bd-bea1a74664ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.374173 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e116c8-a28f-43f7-9465-03e0f8e6e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:18.374803 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e116c8-a28f-43f7-9465-03e0f8e6e925 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.375080 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e116c8-a28f-43f7-9465-03e0f8e6e925 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.375350 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e116c8-a28f-43f7-9465-03e0f8e6e925 None admin] PATH_INFO: `/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.380069 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-4bcdd614-4e5d-4e96-b8bd-bea1a74664ac None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:18.381453 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-4bcdd614-4e5d-4e96-b8bd-bea1a74664ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:18.391456 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e116c8-a28f-43f7-9465-03e0f8e6e925 None admin] RBAC: Authorizing `identity:get_user(user_id=6b79b1b5bdfa48c3be283dd8d7efa8f3)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:18.392933 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e116c8-a28f-43f7-9465-03e0f8e6e925 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:18.394579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 36/67] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:18 2022] GET /identity/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:18.395332 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e116c8-a28f-43f7-9465-03e0f8e6e925 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:18.455691 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 32/68] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:18.456960 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdd614-4e5d-4e96-b8bd-bea1a74664ac None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:18.508506 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:18.515345 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e116c8-a28f-43f7-9465-03e0f8e6e925 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:18.550406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:18.551912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1adee9-b68e-43fd-be41-424413633b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:18.552590 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1adee9-b68e-43fd-be41-424413633b8d None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.553062 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1adee9-b68e-43fd-be41-424413633b8d None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.553349 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1adee9-b68e-43fd-be41-424413633b8d None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.554024 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1adee9-b68e-43fd-be41-424413633b8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:18.554357 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1adee9-b68e-43fd-be41-424413633b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:18.555736 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1adee9-b68e-43fd-be41-424413633b8d None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:18.565070 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 37/69] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:18.565807 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1adee9-b68e-43fd-be41-424413633b8d None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:18.572424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdd614-4e5d-4e96-b8bd-bea1a74664ac None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:18.612368 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d58644-af84-4c7d-a330-4ea96e7a3b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:18.613191 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58644-af84-4c7d-a330-4ea96e7a3b74 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.613478 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58644-af84-4c7d-a330-4ea96e7a3b74 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.613754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58644-af84-4c7d-a330-4ea96e7a3b74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.626938 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d58644-af84-4c7d-a330-4ea96e7a3b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-d6d58644-af84-4c7d-a330-4ea96e7a3b74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:18.632777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:18.633628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:18.635406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 33/70] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:05:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:18.636225 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d58644-af84-4c7d-a330-4ea96e7a3b74 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:18.696244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1adee9-b68e-43fd-be41-424413633b8d None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:18.733004 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4aae-5975-46c4-a3da-de5612f05767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:18.733650 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4aae-5975-46c4-a3da-de5612f05767 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.733928 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4aae-5975-46c4-a3da-de5612f05767 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.734203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c4aae-5975-46c4-a3da-de5612f05767 None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.735350 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c4aae-5975-46c4-a3da-de5612f05767 None admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:18.736922 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c4aae-5975-46c4-a3da-de5612f05767 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:18.740373 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 38/71] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:18 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:18.740373 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4aae-5975-46c4-a3da-de5612f05767 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:18.761431 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d58644-af84-4c7d-a330-4ea96e7a3b74 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:18.769971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:18.798865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694a54e-d086-4ec7-b060-1f4e332cf1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:18.799487 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694a54e-d086-4ec7-b060-1f4e332cf1d0 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.799761 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694a54e-d086-4ec7-b060-1f4e332cf1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.800030 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694a54e-d086-4ec7-b060-1f4e332cf1d0 None admin] PATH_INFO: `/v3/users/cc589496feb245fc97089364fc0bb055` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.801177 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694a54e-d086-4ec7-b060-1f4e332cf1d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cc589496feb245fc97089364fc0bb055)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:18.802617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694a54e-d086-4ec7-b060-1f4e332cf1d0 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:18.804172 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 34/72] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:18 2022] GET /identity/v3/users/cc589496feb245fc97089364fc0bb055 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:18.805016 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694a54e-d086-4ec7-b060-1f4e332cf1d0 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:18.819277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:18.847065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c4aae-5975-46c4-a3da-de5612f05767 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:18.879503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0954e-3f3f-4b7e-88e6-09faac39bf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:18.880096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0954e-3f3f-4b7e-88e6-09faac39bf42 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.880407 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0954e-3f3f-4b7e-88e6-09faac39bf42 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.880682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0954e-3f3f-4b7e-88e6-09faac39bf42 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.881335 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0954e-3f3f-4b7e-88e6-09faac39bf42 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:18.881635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0954e-3f3f-4b7e-88e6-09faac39bf42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:18.882987 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0954e-3f3f-4b7e-88e6-09faac39bf42 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:18.891302 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 39/73] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:05:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:18.892366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0954e-3f3f-4b7e-88e6-09faac39bf42 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:18.905280 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694a54e-d086-4ec7-b060-1f4e332cf1d0 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:18.938850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426ebe-d68e-4439-84c4-3ec3cdc4abbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:18.939471 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426ebe-d68e-4439-84c4-3ec3cdc4abbf None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:18.939754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426ebe-d68e-4439-84c4-3ec3cdc4abbf None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:18.940026 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6426ebe-d68e-4439-84c4-3ec3cdc4abbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:18.949890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6426ebe-d68e-4439-84c4-3ec3cdc4abbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-a6426ebe-d68e-4439-84c4-3ec3cdc4abbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:18.955127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:18.955987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:18.956760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 35/74] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:18.957407 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426ebe-d68e-4439-84c4-3ec3cdc4abbf None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:18.983380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:18.995452 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0954e-3f3f-4b7e-88e6-09faac39bf42 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:19.027950 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b83faf-0ffd-4f85-8c7c-e2f97e15101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:19.028712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b83faf-0ffd-4f85-8c7c-e2f97e15101c None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:19.029023 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b83faf-0ffd-4f85-8c7c-e2f97e15101c None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:19.029215 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:19.029335 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b83faf-0ffd-4f85-8c7c-e2f97e15101c None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/users/6b79b1b5bdfa48c3be283dd8d7efa8f3/roles/bbdc52113ece4f3da0ee37763b27b9e5` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:19.031443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b83faf-0ffd-4f85-8c7c-e2f97e15101c None admin] RBAC: Authorizing `identity:create_grant(project_id=9c71f771e47847d7a5d6f6da015ee47e, user_id=6b79b1b5bdfa48c3be283dd8d7efa8f3, role_id=bbdc52113ece4f3da0ee37763b27b9e5)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:19.033079 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b83faf-0ffd-4f85-8c7c-e2f97e15101c None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:19.046903 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 40/75] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:05:18 2022] PUT /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/users/6b79b1b5bdfa48c3be283dd8d7efa8f3/roles/bbdc52113ece4f3da0ee37763b27b9e5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:05:19.047687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b83faf-0ffd-4f85-8c7c-e2f97e15101c None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:19.077556 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6426ebe-d68e-4439-84c4-3ec3cdc4abbf None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:19.115202 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2374c-8326-4bac-b2f9-7c7decc9f1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:19.115853 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2374c-8326-4bac-b2f9-7c7decc9f1fe None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:19.116132 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2374c-8326-4bac-b2f9-7c7decc9f1fe None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:19.116438 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2374c-8326-4bac-b2f9-7c7decc9f1fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:19.117680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2374c-8326-4bac-b2f9-7c7decc9f1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:19.119950 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2374c-8326-4bac-b2f9-7c7decc9f1fe None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:19.121795 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 36/76] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:19.127218 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2374c-8326-4bac-b2f9-7c7decc9f1fe None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:19.167612 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b83faf-0ffd-4f85-8c7c-e2f97e15101c None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:19.205009 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503256b6-c886-43bd-aec4-3686ab3ce9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:19.205827 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503256b6-c886-43bd-aec4-3686ab3ce9b9 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:19.206122 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503256b6-c886-43bd-aec4-3686ab3ce9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:19.206403 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503256b6-c886-43bd-aec4-3686ab3ce9b9 None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:19.208505 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503256b6-c886-43bd-aec4-3686ab3ce9b9 None admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:19.209991 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503256b6-c886-43bd-aec4-3686ab3ce9b9 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:19.217607 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 41/77] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:19 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:19.217607 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503256b6-c886-43bd-aec4-3686ab3ce9b9 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:19.237686 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:19.241573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2374c-8326-4bac-b2f9-7c7decc9f1fe None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:19.281391 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278a67f-c81e-457f-bbd6-4d5a47784688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:19.282135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278a67f-c81e-457f-bbd6-4d5a47784688 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:19.282413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278a67f-c81e-457f-bbd6-4d5a47784688 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:19.282684 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278a67f-c81e-457f-bbd6-4d5a47784688 None admin] PATH_INFO: `/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:19.283823 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278a67f-c81e-457f-bbd6-4d5a47784688 None admin] RBAC: Authorizing `identity:get_user(user_id=6b79b1b5bdfa48c3be283dd8d7efa8f3)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:19.285414 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278a67f-c81e-457f-bbd6-4d5a47784688 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:19.287099 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 37/78] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:19 2022] GET /identity/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:19.287827 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278a67f-c81e-457f-bbd6-4d5a47784688 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:19.305043 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:19.339280 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503256b6-c886-43bd-aec4-3686ab3ce9b9 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:19.375986 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3f4d3-48f8-40de-a1f7-f69277ef7c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:19.376644 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3f4d3-48f8-40de-a1f7-f69277ef7c7d None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:19.376924 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3f4d3-48f8-40de-a1f7-f69277ef7c7d None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:19.377197 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3f4d3-48f8-40de-a1f7-f69277ef7c7d None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:19.377852 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3f4d3-48f8-40de-a1f7-f69277ef7c7d None admin] RBAC: Adding query filter params (name=member) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:19.378152 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3f4d3-48f8-40de-a1f7-f69277ef7c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:19.379523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3f4d3-48f8-40de-a1f7-f69277ef7c7d None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:19.393437 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 42/79] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:19.393437 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3f4d3-48f8-40de-a1f7-f69277ef7c7d None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:19.405485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278a67f-c81e-457f-bbd6-4d5a47784688 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:19.440538 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7730ce7-b92d-42e7-a5d4-a2ce2c23f567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:19.441253 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7730ce7-b92d-42e7-a5d4-a2ce2c23f567 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:19.441537 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7730ce7-b92d-42e7-a5d4-a2ce2c23f567 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:19.441809 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7730ce7-b92d-42e7-a5d4-a2ce2c23f567 None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:19.442463 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7730ce7-b92d-42e7-a5d4-a2ce2c23f567 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:19.443902 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7730ce7-b92d-42e7-a5d4-a2ce2c23f567 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:19.472628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 38/80] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:05:19 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:19.473457 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7730ce7-b92d-42e7-a5d4-a2ce2c23f567 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:19.491007 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:19.519784 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3f4d3-48f8-40de-a1f7-f69277ef7c7d None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:19.563076 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f0f9-1938-48b5-b6f8-a62ab69929e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:19.564320 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f0f9-1938-48b5-b6f8-a62ab69929e8 None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:19.565076 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f0f9-1938-48b5-b6f8-a62ab69929e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:19.565577 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f0f9-1938-48b5-b6f8-a62ab69929e8 None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/users/cc589496feb245fc97089364fc0bb055/roles/fde247f30afe4b81958b67c776cabec0` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:19.567716 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719f0f9-1938-48b5-b6f8-a62ab69929e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c71f771e47847d7a5d6f6da015ee47e, user_id=cc589496feb245fc97089364fc0bb055, role_id=fde247f30afe4b81958b67c776cabec0)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:19.569234 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719f0f9-1938-48b5-b6f8-a62ab69929e8 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:19.587239 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:19.588643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 43/81] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:05:19 2022] PUT /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/users/cc589496feb245fc97089364fc0bb055/roles/fde247f30afe4b81958b67c776cabec0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:05:19.590042 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f0f9-1938-48b5-b6f8-a62ab69929e8 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:19.648751 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7730ce7-b92d-42e7-a5d4-a2ce2c23f567 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:19.688520 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bcbc2-e74f-4672-b419-1f5a37975d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:19.689400 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bcbc2-e74f-4672-b419-1f5a37975d0b None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:19.689842 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bcbc2-e74f-4672-b419-1f5a37975d0b None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:19.690233 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bcbc2-e74f-4672-b419-1f5a37975d0b None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:19.695435 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bcbc2-e74f-4672-b419-1f5a37975d0b None admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:19.698610 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bcbc2-e74f-4672-b419-1f5a37975d0b None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:19.700836 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 39/82] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:19 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:19.708305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bcbc2-e74f-4672-b419-1f5a37975d0b None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:19.739157 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f0f9-1938-48b5-b6f8-a62ab69929e8 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:19.804193 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c40a2-0073-49cf-a97b-36c1089dc6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:19.804874 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c40a2-0073-49cf-a97b-36c1089dc6b8 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:19.805154 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c40a2-0073-49cf-a97b-36c1089dc6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:19.805428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c40a2-0073-49cf-a97b-36c1089dc6b8 None admin] PATH_INFO: `/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:19.807348 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c40a2-0073-49cf-a97b-36c1089dc6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=6b79b1b5bdfa48c3be283dd8d7efa8f3)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:19.808973 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c40a2-0073-49cf-a97b-36c1089dc6b8 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:19.810594 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 44/83] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:19 2022] GET /identity/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:19.816234 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c40a2-0073-49cf-a97b-36c1089dc6b8 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:19.830299 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:19.878511 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bcbc2-e74f-4672-b419-1f5a37975d0b None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:19.934221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:19.941567 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e52cc-dc28-49a7-9b16-ab3c9991d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:19.942393 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e52cc-dc28-49a7-9b16-ab3c9991d85e None admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:19.942679 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e52cc-dc28-49a7-9b16-ab3c9991d85e None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:19.942948 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e52cc-dc28-49a7-9b16-ab3c9991d85e None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/users/6b79b1b5bdfa48c3be283dd8d7efa8f3/roles/e399cea584ee4afd9e0dbad4959cd49c` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:19.947452 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e52cc-dc28-49a7-9b16-ab3c9991d85e None admin] RBAC: Authorizing `identity:create_grant(project_id=9c71f771e47847d7a5d6f6da015ee47e, user_id=6b79b1b5bdfa48c3be283dd8d7efa8f3, role_id=e399cea584ee4afd9e0dbad4959cd49c)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:19.949748 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e52cc-dc28-49a7-9b16-ab3c9991d85e None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:19.968797 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 40/84] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:05:19 2022] PUT /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/users/6b79b1b5bdfa48c3be283dd8d7efa8f3/roles/e399cea584ee4afd9e0dbad4959cd49c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 19:05:19.970180 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c40a2-0073-49cf-a97b-36c1089dc6b8 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:20.014372 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae12528-3a3f-440a-9ede-60ea9f1cd0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:20.015090 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae12528-3a3f-440a-9ede-60ea9f1cd0da None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:20.015378 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae12528-3a3f-440a-9ede-60ea9f1cd0da None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:20.015656 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae12528-3a3f-440a-9ede-60ea9f1cd0da None admin] PATH_INFO: `/v3/projects/dc2169d04d424e5cacfcea0ecdc23af6` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:20.018426 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae12528-3a3f-440a-9ede-60ea9f1cd0da None admin] RBAC: Authorizing `identity:get_project(project_id=dc2169d04d424e5cacfcea0ecdc23af6)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:20.019897 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae12528-3a3f-440a-9ede-60ea9f1cd0da None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:20.021768 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 45/85] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:19 2022] GET /identity/v3/projects/dc2169d04d424e5cacfcea0ecdc23af6 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:20.027817 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e52cc-dc28-49a7-9b16-ab3c9991d85e None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:20.156815 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e52cc-dc28-49a7-9b16-ab3c9991d85e None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:20.202320 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81db408-d3ab-44cf-ac42-4b9c103f77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:20.203006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81db408-d3ab-44cf-ac42-4b9c103f77b6 None admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:20.203287 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81db408-d3ab-44cf-ac42-4b9c103f77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:20.203557 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81db408-d3ab-44cf-ac42-4b9c103f77b6 None admin] PATH_INFO: `/v3/projects/dc2169d04d424e5cacfcea0ecdc23af6/users/6b79b1b5bdfa48c3be283dd8d7efa8f3/roles/bbdc52113ece4f3da0ee37763b27b9e5` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:20.205624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81db408-d3ab-44cf-ac42-4b9c103f77b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc2169d04d424e5cacfcea0ecdc23af6, user_id=6b79b1b5bdfa48c3be283dd8d7efa8f3, role_id=bbdc52113ece4f3da0ee37763b27b9e5)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:20.207113 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81db408-d3ab-44cf-ac42-4b9c103f77b6 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:20.224237 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 41/86] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:05:20 2022] PUT /identity/v3/projects/dc2169d04d424e5cacfcea0ecdc23af6/users/6b79b1b5bdfa48c3be283dd8d7efa8f3/roles/bbdc52113ece4f3da0ee37763b27b9e5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 19:05:21.924602 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64bbab-3c6c-4ca4-9eca-39a052a574b4 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:21.925595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64bbab-3c6c-4ca4-9eca-39a052a574b4 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:21.926086 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64bbab-3c6c-4ca4-9eca-39a052a574b4 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:21.927693 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 46/87] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:21.933313 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce832e4-3630-4230-b10f-96e6b0305158 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:21.934107 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce832e4-3630-4230-b10f-96e6b0305158 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:21.934630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce832e4-3630-4230-b10f-96e6b0305158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:21.965401 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-6ce832e4-3630-4230-b10f-96e6b0305158 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:21.966914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-6ce832e4-3630-4230-b10f-96e6b0305158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:22.028935 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:22.062544 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 42/88] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:22.695945 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64bbab-3c6c-4ca4-9eca-39a052a574b4 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:22.799378 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:22.842625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64bbab-3c6c-4ca4-9eca-39a052a574b4 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:22.893873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42287516-aa52-4811-818e-0d9b432d7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:22.894511 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42287516-aa52-4811-818e-0d9b432d7a90 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:22.894787 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42287516-aa52-4811-818e-0d9b432d7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:22.895054 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42287516-aa52-4811-818e-0d9b432d7a90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:22.910308 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42287516-aa52-4811-818e-0d9b432d7a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-42287516-aa52-4811-818e-0d9b432d7a90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:22.915144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:22.916013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:22.916825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 47/89] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:22.922528 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce832e4-3630-4230-b10f-96e6b0305158 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:23.065599 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce832e4-3630-4230-b10f-96e6b0305158 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:23.100835 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b655b-7d1a-4f68-b16f-0964604a9386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:23.101449 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b655b-7d1a-4f68-b16f-0964604a9386 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:23.101730 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b655b-7d1a-4f68-b16f-0964604a9386 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:23.102001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b655b-7d1a-4f68-b16f-0964604a9386 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:23.102711 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b655b-7d1a-4f68-b16f-0964604a9386 None admin] RBAC: Adding query filter params (name=member) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:23.103033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b655b-7d1a-4f68-b16f-0964604a9386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:23.104463 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b655b-7d1a-4f68-b16f-0964604a9386 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:23.113274 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 43/90] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:23.119677 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42287516-aa52-4811-818e-0d9b432d7a90 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:23.230726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42287516-aa52-4811-818e-0d9b432d7a90 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:23.258079 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e2688-5b3e-4ef4-989c-661203ec5a58 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:23.258374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e2688-5b3e-4ef4-989c-661203ec5a58 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:23.258635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e2688-5b3e-4ef4-989c-661203ec5a58 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:23.260913 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 44/91] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:23.265777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80da0-55b4-4668-8fbd-a79e7d720a6c None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:23.266081 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80da0-55b4-4668-8fbd-a79e7d720a6c None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:23.266331 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80da0-55b4-4668-8fbd-a79e7d720a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:23.288611 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-a3a80da0-55b4-4668-8fbd-a79e7d720a6c None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:23.288972 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2728013-55f6-4b22-8f79-eb30698e48bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:23.289624 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2728013-55f6-4b22-8f79-eb30698e48bc None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:23.289905 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2728013-55f6-4b22-8f79-eb30698e48bc None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:23.290700 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2728013-55f6-4b22-8f79-eb30698e48bc None admin] PATH_INFO: `/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:23.291356 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-a3a80da0-55b4-4668-8fbd-a79e7d720a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:23.291896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2728013-55f6-4b22-8f79-eb30698e48bc None admin] RBAC: Authorizing `identity:get_user(user_id=6b79b1b5bdfa48c3be283dd8d7efa8f3)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:23.293618 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2728013-55f6-4b22-8f79-eb30698e48bc None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:23.295622 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 48/92] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:23 2022] GET /identity/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:23.296309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca164f-be96-4250-bd92-36f947d5b841 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:23.296633 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca164f-be96-4250-bd92-36f947d5b841 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:23.296855 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca164f-be96-4250-bd92-36f947d5b841 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:23.298169 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 49/93] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:23.302865 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca164f-be96-4250-bd92-36f947d5b841 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:23.309653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:23.344176 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:23.371427 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 45/94] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 19:05:23.377462 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404057-68d8-4a79-86cc-b7d9d78b9916 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:23.377994 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404057-68d8-4a79-86cc-b7d9d78b9916 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:23.378964 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404057-68d8-4a79-86cc-b7d9d78b9916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:23.417446 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-10404057-68d8-4a79-86cc-b7d9d78b9916 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:23.418647 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-10404057-68d8-4a79-86cc-b7d9d78b9916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:23.543214 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca164f-be96-4250-bd92-36f947d5b841 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:23.589353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f6b2-0098-4b20-954f-5e5c0853d80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:23.589876 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 46/95] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:23.589984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f6b2-0098-4b20-954f-5e5c0853d80f None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:23.590241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f6b2-0098-4b20-954f-5e5c0853d80f None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:23.590517 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679f6b2-0098-4b20-954f-5e5c0853d80f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:23.662904 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679f6b2-0098-4b20-954f-5e5c0853d80f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:23.664309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679f6b2-0098-4b20-954f-5e5c0853d80f None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:23.666513 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:23.733560 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a688f7e-ac50-4425-a1b9-f119a29a73a9 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:23.733870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a688f7e-ac50-4425-a1b9-f119a29a73a9 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:23.734125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a688f7e-ac50-4425-a1b9-f119a29a73a9 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:23.735594 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 47/96] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:23.741559 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f313-b1bf-4107-8206-9ea5343c9941 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:23.741827 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f313-b1bf-4107-8206-9ea5343c9941 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:23.742108 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f313-b1bf-4107-8206-9ea5343c9941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:23.786179 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 50/97] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:05:23.789292 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-4552f313-b1bf-4107-8206-9ea5343c9941 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:23.791018 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-4552f313-b1bf-4107-8206-9ea5343c9941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:23.793213 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f6b2-0098-4b20-954f-5e5c0853d80f None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:23.915124 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679f6b2-0098-4b20-954f-5e5c0853d80f None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:23.916687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:23.955755 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778ed50-140f-4699-b626-0944227dec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:23.956481 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778ed50-140f-4699-b626-0944227dec69 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:23.956768 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778ed50-140f-4699-b626-0944227dec69 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:23.957198 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778ed50-140f-4699-b626-0944227dec69 None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:23.958524 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778ed50-140f-4699-b626-0944227dec69 None admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:23.960037 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778ed50-140f-4699-b626-0944227dec69 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:23.962487 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 51/98] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:23 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:23.963133 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778ed50-140f-4699-b626-0944227dec69 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:23.969583 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 48/99] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 19:05:23.970837 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a514e2-78dc-4dfe-bb76-79350b348128 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:23.971121 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a514e2-78dc-4dfe-bb76-79350b348128 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:23.971391 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a514e2-78dc-4dfe-bb76-79350b348128 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:23.972892 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 49/100] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:23.973582 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a514e2-78dc-4dfe-bb76-79350b348128 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:24.059518 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:24.123366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778ed50-140f-4699-b626-0944227dec69 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:24.153577 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a514e2-78dc-4dfe-bb76-79350b348128 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:24.160789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae5356-aa54-435e-ba1d-2cadfba63b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:24.161420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5356-aa54-435e-ba1d-2cadfba63b00 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.161698 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5356-aa54-435e-ba1d-2cadfba63b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.161969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5356-aa54-435e-ba1d-2cadfba63b00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.173670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae5356-aa54-435e-ba1d-2cadfba63b00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-caae5356-aa54-435e-ba1d-2cadfba63b00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:24.178352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:24.179211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:24.179969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 52/101] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 19:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:24.181426 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26423-06bf-45c0-9a1c-3b94bdcec516 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.181426 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26423-06bf-45c0-9a1c-3b94bdcec516 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.181426 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26423-06bf-45c0-9a1c-3b94bdcec516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.196871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d6f65-4611-4964-af62-dacd72744e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:24.197584 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d6f65-4611-4964-af62-dacd72744e18 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.197938 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d6f65-4611-4964-af62-dacd72744e18 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.198283 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d6f65-4611-4964-af62-dacd72744e18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.199083 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-79e26423-06bf-45c0-9a1c-3b94bdcec516 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:24.199176 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d6f65-4611-4964-af62-dacd72744e18 None admin] RBAC: Adding query filter params (role.id=bbdc52113ece4f3da0ee37763b27b9e5, scope.project.id=9c71f771e47847d7a5d6f6da015ee47e, user.id=6b79b1b5bdfa48c3be283dd8d7efa8f3) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:24.199478 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d6f65-4611-4964-af62-dacd72744e18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:24.200281 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-79e26423-06bf-45c0-9a1c-3b94bdcec516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:24.201121 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d6f65-4611-4964-af62-dacd72744e18 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:24.209685 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 50/102] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:05:23 2022] GET /identity/v3/role_assignments?user.id=6b79b1b5bdfa48c3be283dd8d7efa8f3&scope.project.id=9c71f771e47847d7a5d6f6da015ee47e&role.id=bbdc52113ece4f3da0ee37763b27b9e5 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:24.212364 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d6f65-4611-4964-af62-dacd72744e18 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:24.226226 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:24.277061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 53/103] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:24.278427 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1973e03-620d-4f7c-81b5-4c2a1a3f78bf None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.278784 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1973e03-620d-4f7c-81b5-4c2a1a3f78bf None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.279125 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1973e03-620d-4f7c-81b5-4c2a1a3f78bf None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.280474 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 54/104] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:24.285773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1973e03-620d-4f7c-81b5-4c2a1a3f78bf None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:24.364038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:24.371113 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d6f65-4611-4964-af62-dacd72744e18 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:24.418342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1973e03-620d-4f7c-81b5-4c2a1a3f78bf None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:24.422911 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6360e4b-72e4-46b9-bd4d-e450b1784738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:24.423877 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6360e4b-72e4-46b9-bd4d-e450b1784738 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.424352 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6360e4b-72e4-46b9-bd4d-e450b1784738 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.424779 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6360e4b-72e4-46b9-bd4d-e450b1784738 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.439977 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6360e4b-72e4-46b9-bd4d-e450b1784738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-e6360e4b-72e4-46b9-bd4d-e450b1784738 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:24.447905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:24.448871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:24.449689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:24.451800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 51/105] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:24.454900 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777bbd-1703-45ad-a49d-55028fcdd2af None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.455387 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777bbd-1703-45ad-a49d-55028fcdd2af None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.455975 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777bbd-1703-45ad-a49d-55028fcdd2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.465672 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae11364-a654-4317-9014-7804185d7b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:24.466383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae11364-a654-4317-9014-7804185d7b4a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.466670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae11364-a654-4317-9014-7804185d7b4a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.466949 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae11364-a654-4317-9014-7804185d7b4a None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.467624 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae11364-a654-4317-9014-7804185d7b4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:24.467978 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae11364-a654-4317-9014-7804185d7b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:24.469513 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae11364-a654-4317-9014-7804185d7b4a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:24.477315 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-4e777bbd-1703-45ad-a49d-55028fcdd2af None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:24.478932 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-4e777bbd-1703-45ad-a49d-55028fcdd2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:24.482523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 55/106] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:24.485247 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae11364-a654-4317-9014-7804185d7b4a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:24.516840 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:24.564353 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 52/107] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:24.565551 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e777bbd-1703-45ad-a49d-55028fcdd2af None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:24.613171 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae11364-a654-4317-9014-7804185d7b4a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:24.651296 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c606c-4903-4107-a12b-10c7b48cf818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:24.651928 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c606c-4903-4107-a12b-10c7b48cf818 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.652218 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c606c-4903-4107-a12b-10c7b48cf818 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.652510 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c606c-4903-4107-a12b-10c7b48cf818 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.663002 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c606c-4903-4107-a12b-10c7b48cf818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-f55c606c-4903-4107-a12b-10c7b48cf818 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:24.668806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:24.669653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:24.670444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 56/108] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:24.671077 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c606c-4903-4107-a12b-10c7b48cf818 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:24.677350 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:24.693476 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e777bbd-1703-45ad-a49d-55028fcdd2af None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:24.729498 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f977cc-5a36-40ea-a69b-5e4b476704c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:24.730105 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f977cc-5a36-40ea-a69b-5e4b476704c1 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.730390 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f977cc-5a36-40ea-a69b-5e4b476704c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.730658 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f977cc-5a36-40ea-a69b-5e4b476704c1 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.731318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f977cc-5a36-40ea-a69b-5e4b476704c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:24.731623 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f977cc-5a36-40ea-a69b-5e4b476704c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:24.733138 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f977cc-5a36-40ea-a69b-5e4b476704c1 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:24.740959 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 53/109] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:24.742075 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f977cc-5a36-40ea-a69b-5e4b476704c1 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:24.771715 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:24.793635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c606c-4903-4107-a12b-10c7b48cf818 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:24.829824 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578ff50-c2ab-446b-b3c6-a51a585f7aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:24.830688 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578ff50-c2ab-446b-b3c6-a51a585f7aa9 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.831122 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578ff50-c2ab-446b-b3c6-a51a585f7aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.831397 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578ff50-c2ab-446b-b3c6-a51a585f7aa9 None admin] PATH_INFO: `/v3/users/cc589496feb245fc97089364fc0bb055` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.832551 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578ff50-c2ab-446b-b3c6-a51a585f7aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=cc589496feb245fc97089364fc0bb055)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:24.833974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578ff50-c2ab-446b-b3c6-a51a585f7aa9 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:24.840460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 57/110] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:24 2022] GET /identity/v3/users/cc589496feb245fc97089364fc0bb055 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:24.840460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578ff50-c2ab-446b-b3c6-a51a585f7aa9 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:24.856031 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f977cc-5a36-40ea-a69b-5e4b476704c1 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:24.891701 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb435fb-13d0-4621-9606-14a93688fdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:24.892352 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb435fb-13d0-4621-9606-14a93688fdfb None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.892628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb435fb-13d0-4621-9606-14a93688fdfb None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.892903 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb435fb-13d0-4621-9606-14a93688fdfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.903251 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb435fb-13d0-4621-9606-14a93688fdfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-8fb435fb-13d0-4621-9606-14a93688fdfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:24.908442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:24.909289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:24.910305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 54/111] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:05:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:24.913047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb435fb-13d0-4621-9606-14a93688fdfb None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:24.925267 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:24.942383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578ff50-c2ab-446b-b3c6-a51a585f7aa9 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:24.976614 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a949e-8b61-4092-afc9-c5294dce195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:24.977215 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a949e-8b61-4092-afc9-c5294dce195a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:24.977539 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a949e-8b61-4092-afc9-c5294dce195a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:24.977818 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a949e-8b61-4092-afc9-c5294dce195a None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:24.978467 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a949e-8b61-4092-afc9-c5294dce195a None admin] RBAC: Adding query filter params (name=member) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:24.978763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a949e-8b61-4092-afc9-c5294dce195a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:24.980128 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a949e-8b61-4092-afc9-c5294dce195a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:24.988236 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 58/112] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:24.989140 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a949e-8b61-4092-afc9-c5294dce195a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:25.004693 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:25.016044 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb435fb-13d0-4621-9606-14a93688fdfb None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:25.049867 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670887b-aae4-42c1-958c-063edb4971e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:25.050487 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670887b-aae4-42c1-958c-063edb4971e5 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:25.050766 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670887b-aae4-42c1-958c-063edb4971e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:25.051040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670887b-aae4-42c1-958c-063edb4971e5 None admin] PATH_INFO: `/v3/users/802eef8498bf4dbea98e84c2271fe3b3` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:25.063982 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670887b-aae4-42c1-958c-063edb4971e5 None admin] RBAC: Authorizing `identity:get_user(user_id=802eef8498bf4dbea98e84c2271fe3b3)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:25.065480 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670887b-aae4-42c1-958c-063edb4971e5 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:25.067078 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 55/113] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:24 2022] GET /identity/v3/users/802eef8498bf4dbea98e84c2271fe3b3 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:25.067834 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670887b-aae4-42c1-958c-063edb4971e5 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:25.089891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a949e-8b61-4092-afc9-c5294dce195a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:25.122789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c2afd-f1bc-462d-bd02-e5a588fcbec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:25.123386 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c2afd-f1bc-462d-bd02-e5a588fcbec1 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:25.123666 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c2afd-f1bc-462d-bd02-e5a588fcbec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:25.124201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c2afd-f1bc-462d-bd02-e5a588fcbec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:25.134614 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:25.168480 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670887b-aae4-42c1-958c-063edb4971e5 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:25.190392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c2afd-f1bc-462d-bd02-e5a588fcbec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:25.191836 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c2afd-f1bc-462d-bd02-e5a588fcbec1 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:25.202370 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35077f4b-f013-45f6-be08-b4038f90b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:25.202934 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077f4b-f013-45f6-be08-b4038f90b888 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:25.203210 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077f4b-f013-45f6-be08-b4038f90b888 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:25.203482 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35077f4b-f013-45f6-be08-b4038f90b888 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:25.204614 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35077f4b-f013-45f6-be08-b4038f90b888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:25.205351 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:25.206043 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35077f4b-f013-45f6-be08-b4038f90b888 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:25.207785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 56/114] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:25.208597 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35077f4b-f013-45f6-be08-b4038f90b888 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:25.291792 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 59/115] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:05:25.292916 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c2afd-f1bc-462d-bd02-e5a588fcbec1 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:25.309844 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35077f4b-f013-45f6-be08-b4038f90b888 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:25.342948 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a1354-0b02-4621-a48e-6dcf37b80713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:25.343548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a1354-0b02-4621-a48e-6dcf37b80713 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:25.343830 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a1354-0b02-4621-a48e-6dcf37b80713 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:25.344102 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a1354-0b02-4621-a48e-6dcf37b80713 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:25.345237 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a1354-0b02-4621-a48e-6dcf37b80713 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:25.345237 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a1354-0b02-4621-a48e-6dcf37b80713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:25.346581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a1354-0b02-4621-a48e-6dcf37b80713 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:25.348751 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:25.355038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 57/116] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:05:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:25.355038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a1354-0b02-4621-a48e-6dcf37b80713 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:25.396050 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c2afd-f1bc-462d-bd02-e5a588fcbec1 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:25.408006 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:25.429147 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda53ead-953a-43b3-b13f-6a2ce25e95a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:25.429764 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda53ead-953a-43b3-b13f-6a2ce25e95a2 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:25.430039 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda53ead-953a-43b3-b13f-6a2ce25e95a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:25.430317 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda53ead-953a-43b3-b13f-6a2ce25e95a2 None admin] PATH_INFO: `/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:25.431945 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda53ead-953a-43b3-b13f-6a2ce25e95a2 None admin] RBAC: Authorizing `identity:get_user(user_id=6b79b1b5bdfa48c3be283dd8d7efa8f3)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:25.433401 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda53ead-953a-43b3-b13f-6a2ce25e95a2 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:25.434954 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 60/117] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:25 2022] GET /identity/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:25.439488 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda53ead-953a-43b3-b13f-6a2ce25e95a2 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:25.458333 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a1354-0b02-4621-a48e-6dcf37b80713 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:25.490581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d5a4c-e5ba-45ea-aaee-1f61f1b0e8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:25.491201 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d5a4c-e5ba-45ea-aaee-1f61f1b0e8cf None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:25.491486 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d5a4c-e5ba-45ea-aaee-1f61f1b0e8cf None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:25.491762 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d5a4c-e5ba-45ea-aaee-1f61f1b0e8cf None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:25.492886 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d5a4c-e5ba-45ea-aaee-1f61f1b0e8cf None admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:25.494844 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d5a4c-e5ba-45ea-aaee-1f61f1b0e8cf None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:25.496665 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 58/118] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:25 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:25.497330 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d5a4c-e5ba-45ea-aaee-1f61f1b0e8cf None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:25.535442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda53ead-953a-43b3-b13f-6a2ce25e95a2 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:25.559909 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:25.568397 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc442d1-d3e9-4c6b-a070-cf5e4753431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:25.569037 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc442d1-d3e9-4c6b-a070-cf5e4753431a None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:25.569319 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc442d1-d3e9-4c6b-a070-cf5e4753431a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:25.569595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc442d1-d3e9-4c6b-a070-cf5e4753431a None admin] PATH_INFO: `/v3/projects` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:25.570242 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc442d1-d3e9-4c6b-a070-cf5e4753431a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:25.572447 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc442d1-d3e9-4c6b-a070-cf5e4753431a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:25.595367 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d5a4c-e5ba-45ea-aaee-1f61f1b0e8cf None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:25.597956 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 61/119] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 19:05:25 2022] POST /identity/v3/projects => generated 302 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:25.598786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc442d1-d3e9-4c6b-a070-cf5e4753431a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:25.632458 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:25.634903 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49533ce2-e6eb-481c-ad62-b2f404ec6bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:25.635737 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49533ce2-e6eb-481c-ad62-b2f404ec6bcf None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:25.636015 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49533ce2-e6eb-481c-ad62-b2f404ec6bcf None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:25.636312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49533ce2-e6eb-481c-ad62-b2f404ec6bcf None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:25.637697 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49533ce2-e6eb-481c-ad62-b2f404ec6bcf None admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:25.640190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49533ce2-e6eb-481c-ad62-b2f404ec6bcf None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:25.642434 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 59/120] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:25 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:25.643233 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49533ce2-e6eb-481c-ad62-b2f404ec6bcf None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:25.720036 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc442d1-d3e9-4c6b-a070-cf5e4753431a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:25.759571 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31369c75-842f-48b7-acae-fbffbc49a755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:25.760218 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31369c75-842f-48b7-acae-fbffbc49a755 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:25.760524 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31369c75-842f-48b7-acae-fbffbc49a755 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:25.760792 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31369c75-842f-48b7-acae-fbffbc49a755 None admin] PATH_INFO: `/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:25.761351 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49533ce2-e6eb-481c-ad62-b2f404ec6bcf None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:25.761992 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31369c75-842f-48b7-acae-fbffbc49a755 None admin] RBAC: Authorizing `identity:get_user(user_id=6b79b1b5bdfa48c3be283dd8d7efa8f3)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:25.764035 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31369c75-842f-48b7-acae-fbffbc49a755 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:25.765301 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 62/121] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:25 2022] GET /identity/v3/users/6b79b1b5bdfa48c3be283dd8d7efa8f3 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:25.766079 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31369c75-842f-48b7-acae-fbffbc49a755 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:25.810193 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc773249-f8ca-42ca-87cb-27e0451dfab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:25.810814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc773249-f8ca-42ca-87cb-27e0451dfab9 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:25.811083 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc773249-f8ca-42ca-87cb-27e0451dfab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:25.811353 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc773249-f8ca-42ca-87cb-27e0451dfab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:25.814280 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:25.881387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:25.884916 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31369c75-842f-48b7-acae-fbffbc49a755 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:25.886935 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc773249-f8ca-42ca-87cb-27e0451dfab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:25.889199 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc773249-f8ca-42ca-87cb-27e0451dfab9 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:25.923965 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072460d-b711-459a-8916-b7ea581be39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:25.924920 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072460d-b711-459a-8916-b7ea581be39a None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:25.925340 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072460d-b711-459a-8916-b7ea581be39a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:25.925754 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072460d-b711-459a-8916-b7ea581be39a None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/users/802eef8498bf4dbea98e84c2271fe3b3/roles/57dcd2bc913849469a2c4364a91f53be` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:25.927824 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072460d-b711-459a-8916-b7ea581be39a None admin] RBAC: Authorizing `identity:create_grant(project_id=9c71f771e47847d7a5d6f6da015ee47e, user_id=802eef8498bf4dbea98e84c2271fe3b3, role_id=57dcd2bc913849469a2c4364a91f53be)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:25.929460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072460d-b711-459a-8916-b7ea581be39a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:25.943661 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 63/122] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:05:25 2022] PUT /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/users/802eef8498bf4dbea98e84c2271fe3b3/roles/57dcd2bc913849469a2c4364a91f53be => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:05:25.945079 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072460d-b711-459a-8916-b7ea581be39a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:26.013699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 60/123] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:05:26.014763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc773249-f8ca-42ca-87cb-27e0451dfab9 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:26.053849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:26.094179 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072460d-b711-459a-8916-b7ea581be39a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:26.134156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f463e-7ddc-4e29-83ea-6c12e682607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:26.134871 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f463e-7ddc-4e29-83ea-6c12e682607a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:26.134871 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f463e-7ddc-4e29-83ea-6c12e682607a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:26.135052 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f463e-7ddc-4e29-83ea-6c12e682607a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:26.135931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f463e-7ddc-4e29-83ea-6c12e682607a None admin] RBAC: Adding query filter params (role.id=fde247f30afe4b81958b67c776cabec0, scope.project.id=9c71f771e47847d7a5d6f6da015ee47e, user.id=cc589496feb245fc97089364fc0bb055) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:26.136150 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f463e-7ddc-4e29-83ea-6c12e682607a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:26.137748 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f463e-7ddc-4e29-83ea-6c12e682607a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:26.143017 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc773249-f8ca-42ca-87cb-27e0451dfab9 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:26.144511 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 64/124] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:05:25 2022] GET /identity/v3/role_assignments?user.id=cc589496feb245fc97089364fc0bb055&scope.project.id=9c71f771e47847d7a5d6f6da015ee47e&role.id=fde247f30afe4b81958b67c776cabec0 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:26.145419 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f463e-7ddc-4e29-83ea-6c12e682607a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:26.183919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:26.194981 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98b62-f581-4c80-a84c-14e037fe93ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:26.195781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98b62-f581-4c80-a84c-14e037fe93ac None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:26.196298 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98b62-f581-4c80-a84c-14e037fe93ac None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:26.197024 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98b62-f581-4c80-a84c-14e037fe93ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:26.279814 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f463e-7ddc-4e29-83ea-6c12e682607a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:26.280165 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba98b62-f581-4c80-a84c-14e037fe93ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:26.281741 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba98b62-f581-4c80-a84c-14e037fe93ac None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:26.317372 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3d561-561b-4101-be2c-8acb7b6e0dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:26.318023 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d561-561b-4101-be2c-8acb7b6e0dc9 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:26.318301 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d561-561b-4101-be2c-8acb7b6e0dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:26.318573 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d561-561b-4101-be2c-8acb7b6e0dc9 None admin] PATH_INFO: `/v3/projects/dc2169d04d424e5cacfcea0ecdc23af6` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:26.319741 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3d561-561b-4101-be2c-8acb7b6e0dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=dc2169d04d424e5cacfcea0ecdc23af6)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:26.321808 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3d561-561b-4101-be2c-8acb7b6e0dc9 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:26.324241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 65/125] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:26 2022] GET /identity/v3/projects/dc2169d04d424e5cacfcea0ecdc23af6 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:26.330596 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3d561-561b-4101-be2c-8acb7b6e0dc9 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:26.333794 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:26.437778 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:26.444337 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3d561-561b-4101-be2c-8acb7b6e0dc9 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:26.467401 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 61/126] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:05:26.475179 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98b62-f581-4c80-a84c-14e037fe93ac None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:26.490398 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309793da-2318-49a2-aece-805a7ca159bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:26.491118 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309793da-2318-49a2-aece-805a7ca159bc None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:26.491408 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309793da-2318-49a2-aece-805a7ca159bc None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:26.491684 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309793da-2318-49a2-aece-805a7ca159bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:26.492563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309793da-2318-49a2-aece-805a7ca159bc None admin] RBAC: Adding query filter params (role.id=bbdc52113ece4f3da0ee37763b27b9e5, scope.project.id=dc2169d04d424e5cacfcea0ecdc23af6, user.id=6b79b1b5bdfa48c3be283dd8d7efa8f3) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:26.492880 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309793da-2318-49a2-aece-805a7ca159bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:26.494674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309793da-2318-49a2-aece-805a7ca159bc None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:26.501908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 66/127] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:05:26 2022] GET /identity/v3/role_assignments?user.id=6b79b1b5bdfa48c3be283dd8d7efa8f3&scope.project.id=dc2169d04d424e5cacfcea0ecdc23af6&role.id=bbdc52113ece4f3da0ee37763b27b9e5 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:26.622866 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98b62-f581-4c80-a84c-14e037fe93ac None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:26.662820 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0c410-f97a-4ba8-ae28-125acb81c88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:26.663855 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0c410-f97a-4ba8-ae28-125acb81c88c None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:26.664382 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0c410-f97a-4ba8-ae28-125acb81c88c None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:26.665107 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0c410-f97a-4ba8-ae28-125acb81c88c None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:26.666816 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0c410-f97a-4ba8-ae28-125acb81c88c None admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:26.668836 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0c410-f97a-4ba8-ae28-125acb81c88c None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:26.670792 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 62/128] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:26 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:26.677224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309793da-2318-49a2-aece-805a7ca159bc None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:26.801713 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309793da-2318-49a2-aece-805a7ca159bc None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:26.841802 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb02b9f-9acd-43c5-abf5-9b8de6a9fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:26.842420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02b9f-9acd-43c5-abf5-9b8de6a9fc93 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:26.842703 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02b9f-9acd-43c5-abf5-9b8de6a9fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:26.842976 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02b9f-9acd-43c5-abf5-9b8de6a9fc93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:26.843703 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb02b9f-9acd-43c5-abf5-9b8de6a9fc93 None admin] RBAC: Adding query filter params (role.id=e399cea584ee4afd9e0dbad4959cd49c, scope.project.id=9c71f771e47847d7a5d6f6da015ee47e, user.id=6b79b1b5bdfa48c3be283dd8d7efa8f3) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:26.844012 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb02b9f-9acd-43c5-abf5-9b8de6a9fc93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:26.847003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb02b9f-9acd-43c5-abf5-9b8de6a9fc93 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:26.851930 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 67/129] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:05:26 2022] GET /identity/v3/role_assignments?user.id=6b79b1b5bdfa48c3be283dd8d7efa8f3&scope.project.id=9c71f771e47847d7a5d6f6da015ee47e&role.id=e399cea584ee4afd9e0dbad4959cd49c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:28.163632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321baf82-163e-4563-ad2c-2d00adaf3c94 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:28.164127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321baf82-163e-4563-ad2c-2d00adaf3c94 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:28.164127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321baf82-163e-4563-ad2c-2d00adaf3c94 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:28.165839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 63/130] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:28.171154 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335b59-0df4-45cf-b3ba-4fcdd7a60c37 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:28.171569 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335b59-0df4-45cf-b3ba-4fcdd7a60c37 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:28.171699 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335b59-0df4-45cf-b3ba-4fcdd7a60c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:28.190121 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-1c335b59-0df4-45cf-b3ba-4fcdd7a60c37 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:28.191292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-1c335b59-0df4-45cf-b3ba-4fcdd7a60c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:28.205901 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:28.257414 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 68/131] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:28.530013 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa20b-46f6-4a40-9596-6856107db0fc None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:28.530299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa20b-46f6-4a40-9596-6856107db0fc None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:28.530577 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa20b-46f6-4a40-9596-6856107db0fc None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:28.531927 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 64/132] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:28.537294 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ceba1-2ca5-4c24-9453-fffb47dc77f4 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:28.537584 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ceba1-2ca5-4c24-9453-fffb47dc77f4 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:28.537856 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ceba1-2ca5-4c24-9453-fffb47dc77f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:28.557261 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-172ceba1-2ca5-4c24-9453-fffb47dc77f4 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:28.558418 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-172ceba1-2ca5-4c24-9453-fffb47dc77f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:28.582830 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fa20b-46f6-4a40-9596-6856107db0fc None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:28.585750 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:28.623679 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 69/133] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:28.683651 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fa20b-46f6-4a40-9596-6856107db0fc None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:28.717094 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7759144-faba-44db-a744-455b60aeaf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:28.717716 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7759144-faba-44db-a744-455b60aeaf7e None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:28.717994 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7759144-faba-44db-a744-455b60aeaf7e None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:28.718264 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7759144-faba-44db-a744-455b60aeaf7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:28.719349 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7759144-faba-44db-a744-455b60aeaf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:28.720824 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7759144-faba-44db-a744-455b60aeaf7e None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:28.722373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 65/134] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:28.728486 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ceba1-2ca5-4c24-9453-fffb47dc77f4 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:28.810261 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:28.829065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ceba1-2ca5-4c24-9453-fffb47dc77f4 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:28.862165 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e00874-87dc-4199-afd6-743a69fc7932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:28.862765 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e00874-87dc-4199-afd6-743a69fc7932 None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:28.863047 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e00874-87dc-4199-afd6-743a69fc7932 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:28.863320 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e00874-87dc-4199-afd6-743a69fc7932 None admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:28.863971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e00874-87dc-4199-afd6-743a69fc7932 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:28.865458 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e00874-87dc-4199-afd6-743a69fc7932 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:28.885947 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 70/135] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:05:28 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:28.942940 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7759144-faba-44db-a744-455b60aeaf7e None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:29.016545 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:29.051266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7759144-faba-44db-a744-455b60aeaf7e None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:29.085359 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593708f5-4f21-4649-8753-596ce7704b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:29.085907 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593708f5-4f21-4649-8753-596ce7704b43 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:29.086189 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593708f5-4f21-4649-8753-596ce7704b43 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:29.086463 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593708f5-4f21-4649-8753-596ce7704b43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:29.097495 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593708f5-4f21-4649-8753-596ce7704b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-593708f5-4f21-4649-8753-596ce7704b43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:29.103522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:29.104600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:29.105586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 66/136] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:29.110584 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e00874-87dc-4199-afd6-743a69fc7932 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:29.214948 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e00874-87dc-4199-afd6-743a69fc7932 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:29.251705 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daadeae-e7a8-4319-9e02-c85b5d6b9f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:29.252339 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daadeae-e7a8-4319-9e02-c85b5d6b9f53 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:29.252622 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daadeae-e7a8-4319-9e02-c85b5d6b9f53 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:29.252895 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daadeae-e7a8-4319-9e02-c85b5d6b9f53 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:29.253553 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daadeae-e7a8-4319-9e02-c85b5d6b9f53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:29.253857 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daadeae-e7a8-4319-9e02-c85b5d6b9f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:29.255218 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daadeae-e7a8-4319-9e02-c85b5d6b9f53 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:29.257907 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:29.266077 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 71/137] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:29.271835 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593708f5-4f21-4649-8753-596ce7704b43 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:29.381413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593708f5-4f21-4649-8753-596ce7704b43 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:29.411621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:29.419128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcc4b9-b371-42ee-be1d-e2b01395927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:29.419818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcc4b9-b371-42ee-be1d-e2b01395927e None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:29.420106 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcc4b9-b371-42ee-be1d-e2b01395927e None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:29.420411 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcc4b9-b371-42ee-be1d-e2b01395927e None admin] PATH_INFO: `/v3/users/802eef8498bf4dbea98e84c2271fe3b3` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:29.421661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcc4b9-b371-42ee-be1d-e2b01395927e None admin] RBAC: Authorizing `identity:get_user(user_id=802eef8498bf4dbea98e84c2271fe3b3)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:29.423204 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcc4b9-b371-42ee-be1d-e2b01395927e None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:29.424992 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 67/138] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:29 2022] GET /identity/v3/users/802eef8498bf4dbea98e84c2271fe3b3 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:29.431251 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daadeae-e7a8-4319-9e02-c85b5d6b9f53 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:29.543447 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daadeae-e7a8-4319-9e02-c85b5d6b9f53 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:29.579249 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6e301-1fa5-49d6-bac6-7a195d5b6850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:29.579864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6e301-1fa5-49d6-bac6-7a195d5b6850 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:29.580157 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6e301-1fa5-49d6-bac6-7a195d5b6850 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:29.580467 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6e301-1fa5-49d6-bac6-7a195d5b6850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:29.651916 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6e301-1fa5-49d6-bac6-7a195d5b6850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:29.653336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6e301-1fa5-49d6-bac6-7a195d5b6850 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:29.656572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:29.757690 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 72/139] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:05:29.763873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcc4b9-b371-42ee-be1d-e2b01395927e None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:29.870258 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcc4b9-b371-42ee-be1d-e2b01395927e None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:29.907427 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cfdf3-200d-4b93-9ca5-2e156e34174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:29.908382 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfdf3-200d-4b93-9ca5-2e156e34174a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:29.908871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfdf3-200d-4b93-9ca5-2e156e34174a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:29.909349 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfdf3-200d-4b93-9ca5-2e156e34174a None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:29.910656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cfdf3-200d-4b93-9ca5-2e156e34174a None admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:29.912299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cfdf3-200d-4b93-9ca5-2e156e34174a None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:29.914112 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 68/140] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:29 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:29.920393 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6e301-1fa5-49d6-bac6-7a195d5b6850 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:30.017048 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:30.020732 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6e301-1fa5-49d6-bac6-7a195d5b6850 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:30.057189 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff40ba-a8c6-46c5-9ebe-7dc73458c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:30.057795 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff40ba-a8c6-46c5-9ebe-7dc73458c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:30.058134 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff40ba-a8c6-46c5-9ebe-7dc73458c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:30.058408 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff40ba-a8c6-46c5-9ebe-7dc73458c2b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:30.059188 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff40ba-a8c6-46c5-9ebe-7dc73458c2b2 None admin] RBAC: Adding query filter params (role.id=57dcd2bc913849469a2c4364a91f53be, scope.project.id=9c71f771e47847d7a5d6f6da015ee47e, user.id=802eef8498bf4dbea98e84c2271fe3b3) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:30.059487 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff40ba-a8c6-46c5-9ebe-7dc73458c2b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:30.060991 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff40ba-a8c6-46c5-9ebe-7dc73458c2b2 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:30.067092 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 73/141] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:05:29 2022] GET /identity/v3/role_assignments?user.id=802eef8498bf4dbea98e84c2271fe3b3&scope.project.id=9c71f771e47847d7a5d6f6da015ee47e&role.id=57dcd2bc913849469a2c4364a91f53be => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:31.440376 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93284a-72dc-4dd5-bee2-2957200a8edc None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:31.440890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93284a-72dc-4dd5-bee2-2957200a8edc None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:31.441195 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93284a-72dc-4dd5-bee2-2957200a8edc None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:31.442499 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 69/142] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:31.448169 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf406-95b1-418c-8dbd-3f0b2ea2a2a5 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:31.448620 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf406-95b1-418c-8dbd-3f0b2ea2a2a5 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:31.448739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf406-95b1-418c-8dbd-3f0b2ea2a2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:31.467773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-3cbcf406-95b1-418c-8dbd-3f0b2ea2a2a5 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:31.468985 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-3cbcf406-95b1-418c-8dbd-3f0b2ea2a2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:31.540805 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 74/143] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:31.548838 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bc6e1-bd60-45a8-8fa4-8581350b1ca8 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:31.549128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bc6e1-bd60-45a8-8fa4-8581350b1ca8 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:31.549400 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bc6e1-bd60-45a8-8fa4-8581350b1ca8 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:31.550753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 70/144] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:31.556219 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063beeb-6127-460b-84ab-357a6bd308fb None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:31.556606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063beeb-6127-460b-84ab-357a6bd308fb None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:31.556877 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063beeb-6127-460b-84ab-357a6bd308fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:31.576531 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-6063beeb-6127-460b-84ab-357a6bd308fb None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:31.577903 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-6063beeb-6127-460b-84ab-357a6bd308fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:31.644410 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 75/145] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:31.722208 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17176f67-41e5-4f1b-be78-f162066fc66d None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:31.722497 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17176f67-41e5-4f1b-be78-f162066fc66d None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:31.722771 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17176f67-41e5-4f1b-be78-f162066fc66d None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:31.724118 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 71/146] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:31.729674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ca30-ebd9-476e-8aa2-b23fe7bf7a83 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:31.729967 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ca30-ebd9-476e-8aa2-b23fe7bf7a83 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:31.730242 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ca30-ebd9-476e-8aa2-b23fe7bf7a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:31.748047 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-26c8ca30-ebd9-476e-8aa2-b23fe7bf7a83 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:31.749260 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-26c8ca30-ebd9-476e-8aa2-b23fe7bf7a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:31.766625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:31.818240 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 76/147] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:31.864078 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17176f67-41e5-4f1b-be78-f162066fc66d None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:31.932142 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:31.969064 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17176f67-41e5-4f1b-be78-f162066fc66d None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:31.970467 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8ca30-ebd9-476e-8aa2-b23fe7bf7a83 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:32.006663 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945d2d1-a676-41eb-b2ad-515af4c5ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.007731 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d2d1-a676-41eb-b2ad-515af4c5ec84 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.008719 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d2d1-a676-41eb-b2ad-515af4c5ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.009002 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945d2d1-a676-41eb-b2ad-515af4c5ec84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.019478 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945d2d1-a676-41eb-b2ad-515af4c5ec84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-5945d2d1-a676-41eb-b2ad-515af4c5ec84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:32.024873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:32.025680 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:32.029373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 72/148] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 19:05:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:32.031553 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945d2d1-a676-41eb-b2ad-515af4c5ec84 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:32.078989 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8ca30-ebd9-476e-8aa2-b23fe7bf7a83 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:32.115155 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d1ed7-1a51-490c-8dd4-62e2f3a832a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.115791 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d1ed7-1a51-490c-8dd4-62e2f3a832a9 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.116065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d1ed7-1a51-490c-8dd4-62e2f3a832a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.116364 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d1ed7-1a51-490c-8dd4-62e2f3a832a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.127626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d1ed7-1a51-490c-8dd4-62e2f3a832a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-3f0d1ed7-1a51-490c-8dd4-62e2f3a832a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:32.134307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:32.135145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:32.135912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 77/149] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:05:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:05:32.142460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d1ed7-1a51-490c-8dd4-62e2f3a832a9 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:32.146945 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945d2d1-a676-41eb-b2ad-515af4c5ec84 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:32.158821 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:32.174432 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:32.183259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc71ec5-f996-41d9-954b-9700e251f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.183855 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc71ec5-f996-41d9-954b-9700e251f136 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.184132 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc71ec5-f996-41d9-954b-9700e251f136 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.184442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc71ec5-f996-41d9-954b-9700e251f136 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.185114 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc71ec5-f996-41d9-954b-9700e251f136 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:32.185418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc71ec5-f996-41d9-954b-9700e251f136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:32.186791 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc71ec5-f996-41d9-954b-9700e251f136 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:32.194699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 73/150] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:32.197085 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc71ec5-f996-41d9-954b-9700e251f136 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:32.246163 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d1ed7-1a51-490c-8dd4-62e2f3a832a9 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:32.281624 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5be83b-d419-43fe-9ff3-fa5270a7499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.282311 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be83b-d419-43fe-9ff3-fa5270a7499b None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.282599 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be83b-d419-43fe-9ff3-fa5270a7499b None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.282867 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5be83b-d419-43fe-9ff3-fa5270a7499b None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.283529 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5be83b-d419-43fe-9ff3-fa5270a7499b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:32.283828 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5be83b-d419-43fe-9ff3-fa5270a7499b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:32.285218 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5be83b-d419-43fe-9ff3-fa5270a7499b None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:32.293588 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 78/151] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:05:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:32.294278 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5be83b-d419-43fe-9ff3-fa5270a7499b None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:32.301466 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc71ec5-f996-41d9-954b-9700e251f136 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:32.336238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f10e05-0268-4b9f-9ca5-b1a1aa19582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.337300 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f10e05-0268-4b9f-9ca5-b1a1aa19582f None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.337728 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f10e05-0268-4b9f-9ca5-b1a1aa19582f None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.338001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f10e05-0268-4b9f-9ca5-b1a1aa19582f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.339335 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f10e05-0268-4b9f-9ca5-b1a1aa19582f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:32.341477 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f10e05-0268-4b9f-9ca5-b1a1aa19582f None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:32.343480 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 74/152] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:32.344249 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f10e05-0268-4b9f-9ca5-b1a1aa19582f None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:32.370448 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:32.396203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5be83b-d419-43fe-9ff3-fa5270a7499b None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:32.401051 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:32.429996 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d3b0a-254e-4fa4-b286-1a72ccff15de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.430721 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d3b0a-254e-4fa4-b286-1a72ccff15de None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.431044 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d3b0a-254e-4fa4-b286-1a72ccff15de None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.431315 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d3b0a-254e-4fa4-b286-1a72ccff15de None admin] PATH_INFO: `/v3/users/3156ab135d7c46fe84ed51d7a20490c4` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.444089 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d3b0a-254e-4fa4-b286-1a72ccff15de None admin] RBAC: Authorizing `identity:get_user(user_id=3156ab135d7c46fe84ed51d7a20490c4)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:32.445566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d3b0a-254e-4fa4-b286-1a72ccff15de None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:32.446569 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f10e05-0268-4b9f-9ca5-b1a1aa19582f None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:32.447712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 79/153] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:32 2022] GET /identity/v3/users/3156ab135d7c46fe84ed51d7a20490c4 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:32.449981 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d3b0a-254e-4fa4-b286-1a72ccff15de None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:32.481138 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2a496-4db3-4e86-ad1f-f1a9f2954e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.481764 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2a496-4db3-4e86-ad1f-f1a9f2954e29 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.482040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2a496-4db3-4e86-ad1f-f1a9f2954e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.482308 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2a496-4db3-4e86-ad1f-f1a9f2954e29 None admin] PATH_INFO: `/v3/users/3156ab135d7c46fe84ed51d7a20490c4` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.483429 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2a496-4db3-4e86-ad1f-f1a9f2954e29 None admin] RBAC: Authorizing `identity:get_user(user_id=3156ab135d7c46fe84ed51d7a20490c4)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:32.484889 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2a496-4db3-4e86-ad1f-f1a9f2954e29 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:32.486480 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 75/154] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:32 2022] GET /identity/v3/users/3156ab135d7c46fe84ed51d7a20490c4 => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:32.491136 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2a496-4db3-4e86-ad1f-f1a9f2954e29 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:32.553670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d3b0a-254e-4fa4-b286-1a72ccff15de None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:32.582994 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:32.588252 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bf510-a621-4da2-a622-bb42ae51cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.588859 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2a496-4db3-4e86-ad1f-f1a9f2954e29 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:32.588962 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bf510-a621-4da2-a622-bb42ae51cb18 None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.589138 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bf510-a621-4da2-a622-bb42ae51cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.589406 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bf510-a621-4da2-a622-bb42ae51cb18 None admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.590046 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bf510-a621-4da2-a622-bb42ae51cb18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:32.591464 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bf510-a621-4da2-a622-bb42ae51cb18 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:32.611978 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:32.613051 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 80/155] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:05:32 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:32.613929 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bf510-a621-4da2-a622-bb42ae51cb18 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:32.625484 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fb717-f5fd-41fa-a877-9a9dcfd8788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.626536 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fb717-f5fd-41fa-a877-9a9dcfd8788a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.626987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fb717-f5fd-41fa-a877-9a9dcfd8788a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.627511 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fb717-f5fd-41fa-a877-9a9dcfd8788a None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.629005 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fb717-f5fd-41fa-a877-9a9dcfd8788a None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:32.630913 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fb717-f5fd-41fa-a877-9a9dcfd8788a None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:32.637829 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 76/156] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:32 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:32.638812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fb717-f5fd-41fa-a877-9a9dcfd8788a None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:32.732244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bf510-a621-4da2-a622-bb42ae51cb18 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:32.756693 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fb717-f5fd-41fa-a877-9a9dcfd8788a None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:32.770597 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649f9cf-e95c-4f06-b659-0388d15d3185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.771242 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f9cf-e95c-4f06-b659-0388d15d3185 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.771517 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f9cf-e95c-4f06-b659-0388d15d3185 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.771840 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f9cf-e95c-4f06-b659-0388d15d3185 None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.773166 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649f9cf-e95c-4f06-b659-0388d15d3185 None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:32.775113 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649f9cf-e95c-4f06-b659-0388d15d3185 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:32.777057 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 81/157] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:32 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:32.782845 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649f9cf-e95c-4f06-b659-0388d15d3185 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:32.794739 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc2aa0-d0d9-4397-9ecc-fc9d524d7ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.795423 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2aa0-d0d9-4397-9ecc-fc9d524d7ff5 None admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.795695 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2aa0-d0d9-4397-9ecc-fc9d524d7ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.795962 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2aa0-d0d9-4397-9ecc-fc9d524d7ff5 None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967/users/3156ab135d7c46fe84ed51d7a20490c4/roles/fde247f30afe4b81958b67c776cabec0` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.797947 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc2aa0-d0d9-4397-9ecc-fc9d524d7ff5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c3e52ada92f4695b6b642ba8afea967, user_id=3156ab135d7c46fe84ed51d7a20490c4, role_id=fde247f30afe4b81958b67c776cabec0)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:32.799418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc2aa0-d0d9-4397-9ecc-fc9d524d7ff5 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:32.814098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 77/158] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:05:32 2022] PUT /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967/users/3156ab135d7c46fe84ed51d7a20490c4/roles/fde247f30afe4b81958b67c776cabec0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:05:32.852139 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:32.908789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649f9cf-e95c-4f06-b659-0388d15d3185 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:32.948429 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166de69-8fb1-4ed7-a270-4f1f0ceff7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:32.949609 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166de69-8fb1-4ed7-a270-4f1f0ceff7e8 None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:32.949890 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166de69-8fb1-4ed7-a270-4f1f0ceff7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:32.950163 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166de69-8fb1-4ed7-a270-4f1f0ceff7e8 None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967/users/3156ab135d7c46fe84ed51d7a20490c4/roles/e399cea584ee4afd9e0dbad4959cd49c` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:32.952502 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166de69-8fb1-4ed7-a270-4f1f0ceff7e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c3e52ada92f4695b6b642ba8afea967, user_id=3156ab135d7c46fe84ed51d7a20490c4, role_id=e399cea584ee4afd9e0dbad4959cd49c)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:32.953975 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166de69-8fb1-4ed7-a270-4f1f0ceff7e8 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:32.968738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 82/159] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:05:32 2022] PUT /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967/users/3156ab135d7c46fe84ed51d7a20490c4/roles/e399cea584ee4afd9e0dbad4959cd49c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 19:05:35.342476 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23939-34ff-45b7-bf41-dc5677fa2618 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:35.343002 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23939-34ff-45b7-bf41-dc5677fa2618 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:35.343002 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23939-34ff-45b7-bf41-dc5677fa2618 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:35.344388 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 78/160] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:35.345544 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028173d3-c9ce-4092-92a4-0cde3248ae4f None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:35.346631 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028173d3-c9ce-4092-92a4-0cde3248ae4f None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:35.347099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028173d3-c9ce-4092-92a4-0cde3248ae4f None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:35.348915 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 83/161] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:35.349780 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f46cca-7ae1-49af-aca6-43d3ac259c94 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:35.350385 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f46cca-7ae1-49af-aca6-43d3ac259c94 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:35.350889 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f46cca-7ae1-49af-aca6-43d3ac259c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:35.354817 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e764b-41c2-4e31-80e0-d2d13b700c36 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:35.355102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e764b-41c2-4e31-80e0-d2d13b700c36 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:35.355378 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e764b-41c2-4e31-80e0-d2d13b700c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:35.373288 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-21f46cca-7ae1-49af-aca6-43d3ac259c94 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:35.374879 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-21f46cca-7ae1-49af-aca6-43d3ac259c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:35.377342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-b49e764b-41c2-4e31-80e0-d2d13b700c36 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:35.378861 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-b49e764b-41c2-4e31-80e0-d2d13b700c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:35.425581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:35.447861 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 79/162] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:35.455842 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 84/163] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:35.457457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac13e-1948-4323-acfd-7e13a58a0cc4 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:35.457941 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac13e-1948-4323-acfd-7e13a58a0cc4 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:35.458423 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac13e-1948-4323-acfd-7e13a58a0cc4 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:35.459937 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 85/164] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:35.465842 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9ed5-edcb-40d2-8a64-e87a29dac3c2 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:35.466349 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9ed5-edcb-40d2-8a64-e87a29dac3c2 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:35.466817 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9ed5-edcb-40d2-8a64-e87a29dac3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:35.486454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-2dbc9ed5-edcb-40d2-8a64-e87a29dac3c2 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:35.487939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-2dbc9ed5-edcb-40d2-8a64-e87a29dac3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:35.530872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46768bc-f209-4b15-88a6-c14e1fa64969 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:35.531475 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46768bc-f209-4b15-88a6-c14e1fa64969 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:35.531939 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46768bc-f209-4b15-88a6-c14e1fa64969 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:35.533514 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 86/165] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:05:35.538484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1c206-e172-44a6-b268-f4dbb66a99f3 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:35.538975 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1c206-e172-44a6-b268-f4dbb66a99f3 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:35.539948 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1c206-e172-44a6-b268-f4dbb66a99f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:35.560589 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-ffc1c206-e172-44a6-b268-f4dbb66a99f3 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:35.562149 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-ffc1c206-e172-44a6-b268-f4dbb66a99f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:35.562989 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 80/166] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 19:05:35.612596 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:35.644526 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 87/167] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:35.780505 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc9ed5-edcb-40d2-8a64-e87a29dac3c2 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:35.782604 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1c206-e172-44a6-b268-f4dbb66a99f3 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:35.886997 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc9ed5-edcb-40d2-8a64-e87a29dac3c2 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:35.897039 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1c206-e172-44a6-b268-f4dbb66a99f3 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:35.900799 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:35.923294 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf2986-44ff-4c38-a48e-38f2d692b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:35.923916 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf2986-44ff-4c38-a48e-38f2d692b36b None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:35.924303 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf2986-44ff-4c38-a48e-38f2d692b36b None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:35.924480 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf2986-44ff-4c38-a48e-38f2d692b36b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:35.935545 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf2986-44ff-4c38-a48e-38f2d692b36b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:35.935664 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595f049-8f04-4d59-b8bd-a66a934d0f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:35.936287 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f049-8f04-4d59-b8bd-a66a934d0f9f None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:35.936567 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f049-8f04-4d59-b8bd-a66a934d0f9f None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:35.936833 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f049-8f04-4d59-b8bd-a66a934d0f9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:35.938072 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595f049-8f04-4d59-b8bd-a66a934d0f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:35.939492 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595f049-8f04-4d59-b8bd-a66a934d0f9f None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-4faf2986-44ff-4c38-a48e-38f2d692b36b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:35.940447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:35.946596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:35.947413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:35.948539 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 88/168] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:35.948613 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 81/169] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 19:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:35.948613 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf2986-44ff-4c38-a48e-38f2d692b36b None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:35.948730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595f049-8f04-4d59-b8bd-a66a934d0f9f None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:35.994598 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:36.049014 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595f049-8f04-4d59-b8bd-a66a934d0f9f None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:36.049330 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf2986-44ff-4c38-a48e-38f2d692b36b None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:36.081241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eadc0-233a-4002-8365-f78fbc671a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:36.081775 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd0054-4469-4c93-910d-da2c50a2d611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:36.081902 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eadc0-233a-4002-8365-f78fbc671a2c None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:36.082114 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eadc0-233a-4002-8365-f78fbc671a2c None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:36.082363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd0054-4469-4c93-910d-da2c50a2d611 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:36.082454 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eadc0-233a-4002-8365-f78fbc671a2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:36.082635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd0054-4469-4c93-910d-da2c50a2d611 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:36.082899 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd0054-4469-4c93-910d-da2c50a2d611 None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:36.083530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd0054-4469-4c93-910d-da2c50a2d611 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:36.085025 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd0054-4469-4c93-910d-da2c50a2d611 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:36.092194 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445eadc0-233a-4002-8365-f78fbc671a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-445eadc0-233a-4002-8365-f78fbc671a2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:36.097606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:36.098730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:36.099557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 89/170] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:36.100218 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eadc0-233a-4002-8365-f78fbc671a2c None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:36.120314 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 82/171] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:05:35 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:36.120314 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd0054-4469-4c93-910d-da2c50a2d611 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:36.141688 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:36.216096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eadc0-233a-4002-8365-f78fbc671a2c None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:36.218772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:36.222281 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd0054-4469-4c93-910d-da2c50a2d611 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:36.256038 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa84dd-57fc-404b-bd1b-3723185fe7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:36.256714 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa84dd-57fc-404b-bd1b-3723185fe7ed None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:36.256994 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa84dd-57fc-404b-bd1b-3723185fe7ed None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:36.257315 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa84dd-57fc-404b-bd1b-3723185fe7ed None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:36.257952 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa84dd-57fc-404b-bd1b-3723185fe7ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:36.258851 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa84dd-57fc-404b-bd1b-3723185fe7ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:36.260296 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa84dd-57fc-404b-bd1b-3723185fe7ed None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:36.260546 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388101-f09c-4c2f-812a-00e27496ea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:36.261357 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388101-f09c-4c2f-812a-00e27496ea42 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:36.261779 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388101-f09c-4c2f-812a-00e27496ea42 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:36.262180 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388101-f09c-4c2f-812a-00e27496ea42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:36.274982 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 90/172] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:36.274982 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa84dd-57fc-404b-bd1b-3723185fe7ed None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:36.279665 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa388101-f09c-4c2f-812a-00e27496ea42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-aa388101-f09c-4c2f-812a-00e27496ea42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:36.285398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:36.286548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 83/173] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:05:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:36.287428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388101-f09c-4c2f-812a-00e27496ea42 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:36.392285 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:36.393598 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa84dd-57fc-404b-bd1b-3723185fe7ed None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:36.406336 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388101-f09c-4c2f-812a-00e27496ea42 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:36.443237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932d627-43fa-4711-931b-4be10c8deb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:36.443861 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d627-43fa-4711-931b-4be10c8deb27 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:36.444224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d627-43fa-4711-931b-4be10c8deb27 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:36.444730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d627-43fa-4711-931b-4be10c8deb27 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:36.445460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932d627-43fa-4711-931b-4be10c8deb27 None admin] RBAC: Adding query filter params (name=member) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:36.445818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9996c3c-baec-4820-a293-ffc01c26319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:36.446022 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932d627-43fa-4711-931b-4be10c8deb27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:36.446449 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9996c3c-baec-4820-a293-ffc01c26319a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:36.446721 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9996c3c-baec-4820-a293-ffc01c26319a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:36.446988 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9996c3c-baec-4820-a293-ffc01c26319a None admin] PATH_INFO: `/v3/users/3156ab135d7c46fe84ed51d7a20490c4` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:36.447384 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932d627-43fa-4711-931b-4be10c8deb27 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:36.448289 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9996c3c-baec-4820-a293-ffc01c26319a None admin] RBAC: Authorizing `identity:get_user(user_id=3156ab135d7c46fe84ed51d7a20490c4)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:36.452450 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9996c3c-baec-4820-a293-ffc01c26319a None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:36.452450 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 84/174] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:36 2022] GET /identity/v3/users/3156ab135d7c46fe84ed51d7a20490c4 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:36.452450 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9996c3c-baec-4820-a293-ffc01c26319a None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:36.462818 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 91/175] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:36.464181 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932d627-43fa-4711-931b-4be10c8deb27 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:36.504551 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:36.585452 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9996c3c-baec-4820-a293-ffc01c26319a None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:36.587886 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932d627-43fa-4711-931b-4be10c8deb27 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:36.627313 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450eda91-7f68-43e0-b13e-b5c0f9114dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:36.627552 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e1899-c7e3-46c5-817a-dbcf4e171edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:36.627928 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eda91-7f68-43e0-b13e-b5c0f9114dd6 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:36.628205 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eda91-7f68-43e0-b13e-b5c0f9114dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:36.628336 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e1899-c7e3-46c5-817a-dbcf4e171edd None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:36.628511 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eda91-7f68-43e0-b13e-b5c0f9114dd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:36.628682 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e1899-c7e3-46c5-817a-dbcf4e171edd None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:36.629018 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e1899-c7e3-46c5-817a-dbcf4e171edd None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:36.629753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e1899-c7e3-46c5-817a-dbcf4e171edd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:36.630127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e1899-c7e3-46c5-817a-dbcf4e171edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:36.631715 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e1899-c7e3-46c5-817a-dbcf4e171edd None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:36.641402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 85/176] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:05:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:36.642373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e1899-c7e3-46c5-817a-dbcf4e171edd None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:36.664818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:36.700553 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450eda91-7f68-43e0-b13e-b5c0f9114dd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:36.702014 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450eda91-7f68-43e0-b13e-b5c0f9114dd6 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:36.731974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:36.770347 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e1899-c7e3-46c5-817a-dbcf4e171edd None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:36.813385 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a794a-3c2c-4088-9d31-b079696df61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:36.814414 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a794a-3c2c-4088-9d31-b079696df61c None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:36.814778 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a794a-3c2c-4088-9d31-b079696df61c None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:36.815254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a794a-3c2c-4088-9d31-b079696df61c None admin] PATH_INFO: `/v3/users/e7170d58fc4948b982f1effb0ddc18a4` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:36.821524 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 92/177] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:05:36.822680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450eda91-7f68-43e0-b13e-b5c0f9114dd6 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:36.838756 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a794a-3c2c-4088-9d31-b079696df61c None admin] RBAC: Authorizing `identity:get_user(user_id=e7170d58fc4948b982f1effb0ddc18a4)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:36.841009 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a794a-3c2c-4088-9d31-b079696df61c None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:36.843294 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 86/178] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:36 2022] GET /identity/v3/users/e7170d58fc4948b982f1effb0ddc18a4 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:36.847867 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a794a-3c2c-4088-9d31-b079696df61c None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:36.931801 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:36.933666 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450eda91-7f68-43e0-b13e-b5c0f9114dd6 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:36.956174 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a794a-3c2c-4088-9d31-b079696df61c None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:36.964052 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:36.972200 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a3a89-1b53-4e3a-8e01-385a38f7d1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:36.973192 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3a89-1b53-4e3a-8e01-385a38f7d1b8 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:36.973695 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3a89-1b53-4e3a-8e01-385a38f7d1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:36.974434 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3a89-1b53-4e3a-8e01-385a38f7d1b8 None admin] PATH_INFO: `/v3/users/3156ab135d7c46fe84ed51d7a20490c4` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:36.976132 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a3a89-1b53-4e3a-8e01-385a38f7d1b8 None admin] RBAC: Authorizing `identity:get_user(user_id=3156ab135d7c46fe84ed51d7a20490c4)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:36.981921 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a3a89-1b53-4e3a-8e01-385a38f7d1b8 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:36.982605 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 93/179] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:36 2022] GET /identity/v3/users/3156ab135d7c46fe84ed51d7a20490c4 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:36.984230 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a3a89-1b53-4e3a-8e01-385a38f7d1b8 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:37.002657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eb68a-c9a9-49f3-9f97-6adc17831e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:37.003608 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb68a-c9a9-49f3-9f97-6adc17831e87 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:37.003890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb68a-c9a9-49f3-9f97-6adc17831e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:37.004162 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eb68a-c9a9-49f3-9f97-6adc17831e87 None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:37.005533 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5eb68a-c9a9-49f3-9f97-6adc17831e87 None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:37.007171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5eb68a-c9a9-49f3-9f97-6adc17831e87 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:37.009541 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 87/180] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:36 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:37.014773 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eb68a-c9a9-49f3-9f97-6adc17831e87 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:37.109450 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a3a89-1b53-4e3a-8e01-385a38f7d1b8 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:37.136305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eb68a-c9a9-49f3-9f97-6adc17831e87 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:37.149701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1256f-7992-4382-8647-015a95f69ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:37.150884 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1256f-7992-4382-8647-015a95f69ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:37.151382 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1256f-7992-4382-8647-015a95f69ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:37.151842 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1256f-7992-4382-8647-015a95f69ad8 None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:37.153191 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1256f-7992-4382-8647-015a95f69ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:37.154840 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1256f-7992-4382-8647-015a95f69ad8 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:37.157202 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 94/181] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:36 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:37.158153 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1256f-7992-4382-8647-015a95f69ad8 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:37.176051 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58702b0c-51cf-43e1-a9da-3c0ad9e5d3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:37.177325 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58702b0c-51cf-43e1-a9da-3c0ad9e5d3e1 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:37.177611 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58702b0c-51cf-43e1-a9da-3c0ad9e5d3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:37.177880 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58702b0c-51cf-43e1-a9da-3c0ad9e5d3e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:37.197898 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:37.235772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:37.268905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58702b0c-51cf-43e1-a9da-3c0ad9e5d3e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:37.271174 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58702b0c-51cf-43e1-a9da-3c0ad9e5d3e1 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:37.287116 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1256f-7992-4382-8647-015a95f69ad8 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:37.331436 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ad6b6-8abe-462e-b74d-0012714e0e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:37.332560 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ad6b6-8abe-462e-b74d-0012714e0e6e None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:37.333044 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ad6b6-8abe-462e-b74d-0012714e0e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:37.333522 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ad6b6-8abe-462e-b74d-0012714e0e6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:37.334728 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ad6b6-8abe-462e-b74d-0012714e0e6e None admin] RBAC: Adding query filter params (role.id=fde247f30afe4b81958b67c776cabec0, scope.project.id=4c3e52ada92f4695b6b642ba8afea967, user.id=3156ab135d7c46fe84ed51d7a20490c4) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:37.335663 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ad6b6-8abe-462e-b74d-0012714e0e6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:37.338246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ad6b6-8abe-462e-b74d-0012714e0e6e None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:37.346880 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 95/182] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:05:37 2022] GET /identity/v3/role_assignments?user.id=3156ab135d7c46fe84ed51d7a20490c4&scope.project.id=4c3e52ada92f4695b6b642ba8afea967&role.id=fde247f30afe4b81958b67c776cabec0 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:37.347966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ad6b6-8abe-462e-b74d-0012714e0e6e None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:37.417248 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 88/183] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:05:37.423207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58702b0c-51cf-43e1-a9da-3c0ad9e5d3e1 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:37.514992 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:37.581813 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ad6b6-8abe-462e-b74d-0012714e0e6e None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:37.583728 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58702b0c-51cf-43e1-a9da-3c0ad9e5d3e1 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:37.629860 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fe5f9-c537-4590-8e50-acc26f24a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:37.630861 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe5f9-c537-4590-8e50-acc26f24a247 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:37.631356 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe5f9-c537-4590-8e50-acc26f24a247 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:37.631811 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe5f9-c537-4590-8e50-acc26f24a247 None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:37.634157 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fe5f9-c537-4590-8e50-acc26f24a247 None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:37.635201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:37.636233 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fe5f9-c537-4590-8e50-acc26f24a247 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:37.638649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 89/184] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:37 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:37.645947 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fe5f9-c537-4590-8e50-acc26f24a247 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:37.658438 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a609b11-c143-4041-8e11-8412885873bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:37.659111 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609b11-c143-4041-8e11-8412885873bd None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:37.659395 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609b11-c143-4041-8e11-8412885873bd None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:37.659666 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609b11-c143-4041-8e11-8412885873bd None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967/users/e7170d58fc4948b982f1effb0ddc18a4/roles/bbdc52113ece4f3da0ee37763b27b9e5` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:37.661643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a609b11-c143-4041-8e11-8412885873bd None admin] RBAC: Authorizing `identity:create_grant(project_id=4c3e52ada92f4695b6b642ba8afea967, user_id=e7170d58fc4948b982f1effb0ddc18a4, role_id=bbdc52113ece4f3da0ee37763b27b9e5)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:37.663080 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a609b11-c143-4041-8e11-8412885873bd None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:37.685145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 96/185] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:05:37 2022] PUT /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967/users/e7170d58fc4948b982f1effb0ddc18a4/roles/bbdc52113ece4f3da0ee37763b27b9e5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:05:37.784234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fe5f9-c537-4590-8e50-acc26f24a247 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:37.800011 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:37.834405 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfcb3d-6776-49b3-852d-f83ce521a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:37.835098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfcb3d-6776-49b3-852d-f83ce521a384 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:37.835362 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfcb3d-6776-49b3-852d-f83ce521a384 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:37.835630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfcb3d-6776-49b3-852d-f83ce521a384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:37.836487 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfcb3d-6776-49b3-852d-f83ce521a384 None admin] RBAC: Adding query filter params (role.id=e399cea584ee4afd9e0dbad4959cd49c, scope.project.id=4c3e52ada92f4695b6b642ba8afea967, user.id=3156ab135d7c46fe84ed51d7a20490c4) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:37.836790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfcb3d-6776-49b3-852d-f83ce521a384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:37.838251 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfcb3d-6776-49b3-852d-f83ce521a384 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:37.846368 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 90/186] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:05:37 2022] GET /identity/v3/role_assignments?user.id=3156ab135d7c46fe84ed51d7a20490c4&scope.project.id=4c3e52ada92f4695b6b642ba8afea967&role.id=e399cea584ee4afd9e0dbad4959cd49c => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:38.731731 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9e352-5661-4357-9c4d-47bc13e1a3c0 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:38.732229 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9e352-5661-4357-9c4d-47bc13e1a3c0 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:38.732330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9e352-5661-4357-9c4d-47bc13e1a3c0 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:38.733803 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 97/187] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:38.738670 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eac3a-4b15-46e5-8ead-dcc07c7c6e0f None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:38.739064 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eac3a-4b15-46e5-8ead-dcc07c7c6e0f None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:38.739220 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eac3a-4b15-46e5-8ead-dcc07c7c6e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:38.759242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-837eac3a-4b15-46e5-8ead-dcc07c7c6e0f None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:38.760481 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-837eac3a-4b15-46e5-8ead-dcc07c7c6e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:38.830163 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 91/188] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:38.859311 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f5b1-f2c2-47ff-9ebc-7868afbd464e None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:38.859599 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f5b1-f2c2-47ff-9ebc-7868afbd464e None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:38.859857 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f5b1-f2c2-47ff-9ebc-7868afbd464e None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:38.861370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 98/189] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:38.866449 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989e1c7-e75a-44d1-ae42-74960932ec3f None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:38.866740 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989e1c7-e75a-44d1-ae42-74960932ec3f None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:38.867013 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989e1c7-e75a-44d1-ae42-74960932ec3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:38.885994 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-c989e1c7-e75a-44d1-ae42-74960932ec3f None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:38.887166 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-c989e1c7-e75a-44d1-ae42-74960932ec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:38.954015 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 92/190] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:39.160248 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4f5b1-f2c2-47ff-9ebc-7868afbd464e None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:39.264252 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4f5b1-f2c2-47ff-9ebc-7868afbd464e None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:39.285867 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989e1c7-e75a-44d1-ae42-74960932ec3f None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:39.299984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c591-de37-4042-9037-6286482026fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:39.300638 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c591-de37-4042-9037-6286482026fd None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:39.300918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c591-de37-4042-9037-6286482026fd None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:39.301189 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c591-de37-4042-9037-6286482026fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:39.312831 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488c591-de37-4042-9037-6286482026fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-2488c591-de37-4042-9037-6286482026fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:39.318129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:39.318984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:39.319749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 99/191] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:39.325104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c591-de37-4042-9037-6286482026fd None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:39.329074 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:39.381049 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:39.397510 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989e1c7-e75a-44d1-ae42-74960932ec3f None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:39.437057 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d463a-3128-4791-876a-3642c9156258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:39.437682 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d463a-3128-4791-876a-3642c9156258 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:39.437964 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d463a-3128-4791-876a-3642c9156258 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:39.438233 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d463a-3128-4791-876a-3642c9156258 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:39.439334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d463a-3128-4791-876a-3642c9156258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:39.440802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d463a-3128-4791-876a-3642c9156258 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:39.441817 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c591-de37-4042-9037-6286482026fd None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:39.442585 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 93/192] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:39.447741 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d463a-3128-4791-876a-3642c9156258 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:39.482268 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11f24-90de-404e-9579-b431412221d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:39.482895 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11f24-90de-404e-9579-b431412221d4 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:39.483163 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11f24-90de-404e-9579-b431412221d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:39.483438 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd11f24-90de-404e-9579-b431412221d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:39.484107 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd11f24-90de-404e-9579-b431412221d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:39.484452 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd11f24-90de-404e-9579-b431412221d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:39.485820 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd11f24-90de-404e-9579-b431412221d4 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:39.494994 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 100/193] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:39.500058 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11f24-90de-404e-9579-b431412221d4 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:39.563321 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d463a-3128-4791-876a-3642c9156258 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:39.566525 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:39.603786 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be3f88-e4d9-4ccf-a51b-f2fb0aa69937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:39.604852 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be3f88-e4d9-4ccf-a51b-f2fb0aa69937 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:39.605251 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be3f88-e4d9-4ccf-a51b-f2fb0aa69937 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:39.605611 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be3f88-e4d9-4ccf-a51b-f2fb0aa69937 None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:39.606341 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be3f88-e4d9-4ccf-a51b-f2fb0aa69937 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:39.607038 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd11f24-90de-404e-9579-b431412221d4 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:39.608066 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be3f88-e4d9-4ccf-a51b-f2fb0aa69937 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:39.619300 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:39.630856 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 94/194] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:05:39 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 19:05:39.645109 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460dd33-c257-4960-86a1-d894b3671a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:39.645765 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460dd33-c257-4960-86a1-d894b3671a69 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:39.646046 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460dd33-c257-4960-86a1-d894b3671a69 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:39.646303 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460dd33-c257-4960-86a1-d894b3671a69 None admin] PATH_INFO: `/v3/users/5cc0fa63e96b476dad607e6c6449cc6e` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:39.663465 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460dd33-c257-4960-86a1-d894b3671a69 None admin] RBAC: Authorizing `identity:get_user(user_id=5cc0fa63e96b476dad607e6c6449cc6e)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:39.665402 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460dd33-c257-4960-86a1-d894b3671a69 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:39.672220 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 101/195] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:39 2022] GET /identity/v3/users/5cc0fa63e96b476dad607e6c6449cc6e => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:39.675729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be3f88-e4d9-4ccf-a51b-f2fb0aa69937 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:39.798939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be3f88-e4d9-4ccf-a51b-f2fb0aa69937 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:39.835888 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e63cf-ede3-4e37-8a0d-99918232467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:39.837187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e63cf-ede3-4e37-8a0d-99918232467d None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:39.837462 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e63cf-ede3-4e37-8a0d-99918232467d None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:39.837727 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e63cf-ede3-4e37-8a0d-99918232467d None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:39.838875 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e63cf-ede3-4e37-8a0d-99918232467d None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:39.840892 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e63cf-ede3-4e37-8a0d-99918232467d None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:39.846507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 95/196] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:39 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:39.847959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460dd33-c257-4960-86a1-d894b3671a69 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:39.954430 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460dd33-c257-4960-86a1-d894b3671a69 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:39.991082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d363b-0509-4bdc-b443-c1be7be6e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:39.991747 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d363b-0509-4bdc-b443-c1be7be6e155 None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:39.992025 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d363b-0509-4bdc-b443-c1be7be6e155 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:39.992494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d363b-0509-4bdc-b443-c1be7be6e155 None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967/users/5cc0fa63e96b476dad607e6c6449cc6e/roles/57dcd2bc913849469a2c4364a91f53be` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:39.994504 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d363b-0509-4bdc-b443-c1be7be6e155 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c3e52ada92f4695b6b642ba8afea967, user_id=5cc0fa63e96b476dad607e6c6449cc6e, role_id=57dcd2bc913849469a2c4364a91f53be)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:39.995943 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d363b-0509-4bdc-b443-c1be7be6e155 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:40.011458 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 102/197] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:05:39 2022] PUT /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967/users/5cc0fa63e96b476dad607e6c6449cc6e/roles/57dcd2bc913849469a2c4364a91f53be => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:05:40.163670 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1c56-01c2-45b9-a94d-852becc6b4e7 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:40.163843 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1c56-01c2-45b9-a94d-852becc6b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:40.164112 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1c56-01c2-45b9-a94d-852becc6b4e7 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:40.165604 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 96/198] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:40.171669 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf9fbc-0cdf-4a27-a9d8-389cd6cdd880 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:40.171987 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf9fbc-0cdf-4a27-a9d8-389cd6cdd880 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:40.172232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf9fbc-0cdf-4a27-a9d8-389cd6cdd880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:40.196563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-ffbf9fbc-0cdf-4a27-a9d8-389cd6cdd880 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:40.198181 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-ffbf9fbc-0cdf-4a27-a9d8-389cd6cdd880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:40.226437 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:40.276166 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 103/199] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:40.605985 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1c56-01c2-45b9-a94d-852becc6b4e7 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:40.636595 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:40.715952 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1c56-01c2-45b9-a94d-852becc6b4e7 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:40.750224 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dec8c-b1a6-467e-a7d4-edee7333c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:40.751142 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dec8c-b1a6-467e-a7d4-edee7333c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:40.751636 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dec8c-b1a6-467e-a7d4-edee7333c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:40.752094 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dec8c-b1a6-467e-a7d4-edee7333c0c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:40.763423 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dec8c-b1a6-467e-a7d4-edee7333c0c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-788dec8c-b1a6-467e-a7d4-edee7333c0c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:40.768573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:40.769479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:40.770256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:40.772539 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 97/200] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:40.778793 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf9fbc-0cdf-4a27-a9d8-389cd6cdd880 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:40.882977 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf9fbc-0cdf-4a27-a9d8-389cd6cdd880 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:40.922212 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ecb71-23f4-463f-b0fa-c552bf49fb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:40.922815 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ecb71-23f4-463f-b0fa-c552bf49fb96 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:40.923089 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ecb71-23f4-463f-b0fa-c552bf49fb96 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:40.923412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ecb71-23f4-463f-b0fa-c552bf49fb96 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:40.924069 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ecb71-23f4-463f-b0fa-c552bf49fb96 None admin] RBAC: Adding query filter params (name=member) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:40.924395 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ecb71-23f4-463f-b0fa-c552bf49fb96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:40.925912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ecb71-23f4-463f-b0fa-c552bf49fb96 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:40.935234 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 104/201] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:40.940826 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dec8c-b1a6-467e-a7d4-edee7333c0c6 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:41.035931 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:41.050803 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dec8c-b1a6-467e-a7d4-edee7333c0c6 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:41.087582 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a6d4c-80f0-453b-92a4-34aafdb6031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:41.088261 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a6d4c-80f0-453b-92a4-34aafdb6031d None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:41.088553 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a6d4c-80f0-453b-92a4-34aafdb6031d None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:41.088868 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a6d4c-80f0-453b-92a4-34aafdb6031d None admin] PATH_INFO: `/v3/users/e7170d58fc4948b982f1effb0ddc18a4` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:41.089996 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a6d4c-80f0-453b-92a4-34aafdb6031d None admin] RBAC: Authorizing `identity:get_user(user_id=e7170d58fc4948b982f1effb0ddc18a4)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:41.091436 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a6d4c-80f0-453b-92a4-34aafdb6031d None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:41.093112 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 98/202] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:40 2022] GET /identity/v3/users/e7170d58fc4948b982f1effb0ddc18a4 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:41.098684 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ecb71-23f4-463f-b0fa-c552bf49fb96 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:41.122488 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:41.207809 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ecb71-23f4-463f-b0fa-c552bf49fb96 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:41.242787 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d1178-0bcb-48b1-8fcc-92451f91fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:41.243841 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d1178-0bcb-48b1-8fcc-92451f91fd66 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:41.244260 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d1178-0bcb-48b1-8fcc-92451f91fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:41.244692 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d1178-0bcb-48b1-8fcc-92451f91fd66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:41.315437 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d1178-0bcb-48b1-8fcc-92451f91fd66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:41.317432 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d1178-0bcb-48b1-8fcc-92451f91fd66 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:41.339360 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:41.418540 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 105/203] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:05:41.424084 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a6d4c-80f0-453b-92a4-34aafdb6031d None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:41.526505 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a6d4c-80f0-453b-92a4-34aafdb6031d None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:41.560991 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355633b-7f02-4718-9980-cf4f1ec57ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:41.561660 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355633b-7f02-4718-9980-cf4f1ec57ff8 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:41.561885 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355633b-7f02-4718-9980-cf4f1ec57ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:41.562139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355633b-7f02-4718-9980-cf4f1ec57ff8 None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:41.563256 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355633b-7f02-4718-9980-cf4f1ec57ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:41.564718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355633b-7f02-4718-9980-cf4f1ec57ff8 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:41.566962 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 99/204] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:41 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:41.572846 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d1178-0bcb-48b1-8fcc-92451f91fd66 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:41.673383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d1178-0bcb-48b1-8fcc-92451f91fd66 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:41.700664 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:41.712281 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504bda3-d053-4c64-88dd-4f59b3efbbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:41.712903 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504bda3-d053-4c64-88dd-4f59b3efbbc1 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:41.713181 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504bda3-d053-4c64-88dd-4f59b3efbbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:41.713448 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504bda3-d053-4c64-88dd-4f59b3efbbc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:41.714174 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504bda3-d053-4c64-88dd-4f59b3efbbc1 None admin] RBAC: Adding query filter params (role.id=bbdc52113ece4f3da0ee37763b27b9e5, scope.project.id=4c3e52ada92f4695b6b642ba8afea967, user.id=e7170d58fc4948b982f1effb0ddc18a4) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:41.714474 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504bda3-d053-4c64-88dd-4f59b3efbbc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:41.715890 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504bda3-d053-4c64-88dd-4f59b3efbbc1 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:41.721994 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 106/205] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:05:41 2022] GET /identity/v3/role_assignments?user.id=e7170d58fc4948b982f1effb0ddc18a4&scope.project.id=4c3e52ada92f4695b6b642ba8afea967&role.id=bbdc52113ece4f3da0ee37763b27b9e5 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:42.249201 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7375418-05cf-4f26-abf8-fa4db9685f16 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:42.249722 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7375418-05cf-4f26-abf8-fa4db9685f16 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:42.249722 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7375418-05cf-4f26-abf8-fa4db9685f16 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:42.251215 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 100/206] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:42.256162 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b366db-f671-4546-8b79-db06fcb69365 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:42.256578 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b366db-f671-4546-8b79-db06fcb69365 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:42.256803 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b366db-f671-4546-8b79-db06fcb69365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:42.275422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-d9b366db-f671-4546-8b79-db06fcb69365 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:42.276635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-d9b366db-f671-4546-8b79-db06fcb69365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:42.324092 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373acd4-bde1-48ea-a962-053a94bfba17 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:42.324424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373acd4-bde1-48ea-a962-053a94bfba17 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:42.324670 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373acd4-bde1-48ea-a962-053a94bfba17 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:42.326173 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 101/207] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:42.330994 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e0a6-0c7f-48f0-ac0c-f7c73cb972ae None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:42.331268 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e0a6-0c7f-48f0-ac0c-f7c73cb972ae None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:42.331534 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e0a6-0c7f-48f0-ac0c-f7c73cb972ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:42.350529 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 107/208] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:42.356445 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-6178e0a6-0c7f-48f0-ac0c-f7c73cb972ae None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:42.356445 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-6178e0a6-0c7f-48f0-ac0c-f7c73cb972ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:42.370566 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:42.421750 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 102/209] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 19:05:42.655123 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88356e1-77cd-4676-ba09-b92af6e66f5a None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:42.655461 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88356e1-77cd-4676-ba09-b92af6e66f5a None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:42.655640 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88356e1-77cd-4676-ba09-b92af6e66f5a None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:42.657102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 108/210] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:42.662843 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0e0a1-6973-41f5-a73d-4c9f9c533fa4 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:42.663318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0e0a1-6973-41f5-a73d-4c9f9c533fa4 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:42.663474 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0e0a1-6973-41f5-a73d-4c9f9c533fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:42.677906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88356e1-77cd-4676-ba09-b92af6e66f5a None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:42.683393 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-b5e0e0a1-6973-41f5-a73d-4c9f9c533fa4 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:42.684682 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-b5e0e0a1-6973-41f5-a73d-4c9f9c533fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:42.766734 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 103/211] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:42.768986 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0e0a1-6973-41f5-a73d-4c9f9c533fa4 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:42.808710 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88356e1-77cd-4676-ba09-b92af6e66f5a None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:42.827289 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:42.858679 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aab80a-e817-4ba9-8b1a-be0d37bca7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:42.859384 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab80a-e817-4ba9-8b1a-be0d37bca7ae None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:42.859652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab80a-e817-4ba9-8b1a-be0d37bca7ae None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:42.860011 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aab80a-e817-4ba9-8b1a-be0d37bca7ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:42.865395 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:42.873973 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aab80a-e817-4ba9-8b1a-be0d37bca7ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-d7aab80a-e817-4ba9-8b1a-be0d37bca7ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:42.878837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:42.880102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:42.881472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 109/212] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:05:42.885974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aab80a-e817-4ba9-8b1a-be0d37bca7ae None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:42.886097 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0e0a1-6973-41f5-a73d-4c9f9c533fa4 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:42.930792 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0fd8-b1e2-4508-9230-19ace70a9d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:42.931571 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0fd8-b1e2-4508-9230-19ace70a9d61 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:42.931804 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0fd8-b1e2-4508-9230-19ace70a9d61 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:42.932167 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0fd8-b1e2-4508-9230-19ace70a9d61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:42.933405 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf0fd8-b1e2-4508-9230-19ace70a9d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:42.934850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf0fd8-b1e2-4508-9230-19ace70a9d61 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:42.941189 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 104/213] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:42.942187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0fd8-b1e2-4508-9230-19ace70a9d61 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:43.005944 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aab80a-e817-4ba9-8b1a-be0d37bca7ae None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:43.049890 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08031399-2821-4319-8410-ccab1438f2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:43.050501 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08031399-2821-4319-8410-ccab1438f2e9 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:43.050776 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08031399-2821-4319-8410-ccab1438f2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:43.051189 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08031399-2821-4319-8410-ccab1438f2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:43.051773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08031399-2821-4319-8410-ccab1438f2e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:43.052009 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08031399-2821-4319-8410-ccab1438f2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:43.053454 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08031399-2821-4319-8410-ccab1438f2e9 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:43.054522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0fd8-b1e2-4508-9230-19ace70a9d61 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:43.064171 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 110/214] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:43.071043 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08031399-2821-4319-8410-ccab1438f2e9 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:43.109507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc94d2-8fd1-447a-b3ce-a5a8bcd8ff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:43.110224 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc94d2-8fd1-447a-b3ce-a5a8bcd8ff4f None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:43.110573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc94d2-8fd1-447a-b3ce-a5a8bcd8ff4f None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:43.110919 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc94d2-8fd1-447a-b3ce-a5a8bcd8ff4f None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:43.111055 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:43.111684 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc94d2-8fd1-447a-b3ce-a5a8bcd8ff4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:43.113463 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc94d2-8fd1-447a-b3ce-a5a8bcd8ff4f None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:43.144880 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 105/215] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:05:42 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 19:05:43.146479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc94d2-8fd1-447a-b3ce-a5a8bcd8ff4f None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:43.159603 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:43.202761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08031399-2821-4319-8410-ccab1438f2e9 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:43.245171 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c04087-ca93-4737-9822-449cb1ae7872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:43.245810 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c04087-ca93-4737-9822-449cb1ae7872 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:43.246085 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c04087-ca93-4737-9822-449cb1ae7872 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:43.246349 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c04087-ca93-4737-9822-449cb1ae7872 None admin] PATH_INFO: `/v3/users/7b4e3528f6bf44d983fc42a3fe788fb0` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:43.263554 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c04087-ca93-4737-9822-449cb1ae7872 None admin] RBAC: Authorizing `identity:get_user(user_id=7b4e3528f6bf44d983fc42a3fe788fb0)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:43.265684 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c04087-ca93-4737-9822-449cb1ae7872 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:43.268007 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 111/216] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:43 2022] GET /identity/v3/users/7b4e3528f6bf44d983fc42a3fe788fb0 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:43.274192 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c04087-ca93-4737-9822-449cb1ae7872 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:43.293109 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc94d2-8fd1-447a-b3ce-a5a8bcd8ff4f None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:43.332499 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958515b9-9c8e-449a-866a-4f1eefb525e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:43.333168 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958515b9-9c8e-449a-866a-4f1eefb525e5 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:43.333467 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958515b9-9c8e-449a-866a-4f1eefb525e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:43.333746 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958515b9-9c8e-449a-866a-4f1eefb525e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:43.347770 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958515b9-9c8e-449a-866a-4f1eefb525e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-958515b9-9c8e-449a-866a-4f1eefb525e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:43.353924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:43.354912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:43.356047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 106/217] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:43.361031 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958515b9-9c8e-449a-866a-4f1eefb525e5 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:43.400176 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:43.408893 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c04087-ca93-4737-9822-449cb1ae7872 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:43.448437 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:43.452523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f154e-3aaf-453f-bb80-c519f002cbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:43.453206 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f154e-3aaf-453f-bb80-c519f002cbaa None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:43.453427 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f154e-3aaf-453f-bb80-c519f002cbaa None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:43.453700 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f154e-3aaf-453f-bb80-c519f002cbaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:43.454435 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f154e-3aaf-453f-bb80-c519f002cbaa None admin] RBAC: Adding query filter params (role.id=bbdc52113ece4f3da0ee37763b27b9e5, user.id=7b4e3528f6bf44d983fc42a3fe788fb0, scope.system=all) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:43.454744 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f154e-3aaf-453f-bb80-c519f002cbaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:43.456194 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f154e-3aaf-453f-bb80-c519f002cbaa None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:43.464014 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 112/218] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Oct 20 19:05:43 2022] GET /identity/v3/role_assignments?user.id=7b4e3528f6bf44d983fc42a3fe788fb0&scope.system=all&role.id=bbdc52113ece4f3da0ee37763b27b9e5 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:43.492197 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958515b9-9c8e-449a-866a-4f1eefb525e5 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:43.533100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a951c-ba7c-43d8-b875-feecb85156b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:43.533982 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a951c-ba7c-43d8-b875-feecb85156b2 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:43.534402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a951c-ba7c-43d8-b875-feecb85156b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:43.534814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a951c-ba7c-43d8-b875-feecb85156b2 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:43.535678 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a951c-ba7c-43d8-b875-feecb85156b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:43.536132 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a951c-ba7c-43d8-b875-feecb85156b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:43.537742 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a951c-ba7c-43d8-b875-feecb85156b2 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:43.549158 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 107/219] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:43.555315 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f154e-3aaf-453f-bb80-c519f002cbaa None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:43.675252 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f154e-3aaf-453f-bb80-c519f002cbaa None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:43.715754 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc858f5-f30f-432f-a857-5af14ab82f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:43.716374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc858f5-f30f-432f-a857-5af14ab82f4e None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:43.716791 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc858f5-f30f-432f-a857-5af14ab82f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:43.717138 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc858f5-f30f-432f-a857-5af14ab82f4e None admin] PATH_INFO: `/v3/users/5cc0fa63e96b476dad607e6c6449cc6e` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:43.718371 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc858f5-f30f-432f-a857-5af14ab82f4e None admin] RBAC: Authorizing `identity:get_user(user_id=5cc0fa63e96b476dad607e6c6449cc6e)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:43.719889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc858f5-f30f-432f-a857-5af14ab82f4e None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:43.721591 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 113/220] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:43 2022] GET /identity/v3/users/5cc0fa63e96b476dad607e6c6449cc6e => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:43.727597 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a951c-ba7c-43d8-b875-feecb85156b2 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:43.838755 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a951c-ba7c-43d8-b875-feecb85156b2 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:43.869001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:43.875326 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec29199-5e2e-4ba3-bc87-2c1b3613b8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:43.875970 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec29199-5e2e-4ba3-bc87-2c1b3613b8d8 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:43.876565 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec29199-5e2e-4ba3-bc87-2c1b3613b8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:43.877023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec29199-5e2e-4ba3-bc87-2c1b3613b8d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:43.949202 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec29199-5e2e-4ba3-bc87-2c1b3613b8d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:43.950660 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec29199-5e2e-4ba3-bc87-2c1b3613b8d8 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:44.052700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 108/221] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 20 19:05:44.058798 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc858f5-f30f-432f-a857-5af14ab82f4e None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:44.089921 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:44.173251 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc858f5-f30f-432f-a857-5af14ab82f4e None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:44.207915 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5547804-3025-47a7-988e-d63b4fdbe709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:44.208567 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5547804-3025-47a7-988e-d63b4fdbe709 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:44.208841 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5547804-3025-47a7-988e-d63b4fdbe709 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:44.209111 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5547804-3025-47a7-988e-d63b4fdbe709 None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:44.210228 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5547804-3025-47a7-988e-d63b4fdbe709 None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:44.212295 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5547804-3025-47a7-988e-d63b4fdbe709 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:44.214389 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 114/222] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:44 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:44.219980 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec29199-5e2e-4ba3-bc87-2c1b3613b8d8 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:44.251826 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:44.325213 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec29199-5e2e-4ba3-bc87-2c1b3613b8d8 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:44.362870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bffbc0-2f70-42fe-91f8-c4dd08d1efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:44.363516 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bffbc0-2f70-42fe-91f8-c4dd08d1efe4 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:44.363852 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bffbc0-2f70-42fe-91f8-c4dd08d1efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:44.364125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bffbc0-2f70-42fe-91f8-c4dd08d1efe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:44.364871 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bffbc0-2f70-42fe-91f8-c4dd08d1efe4 None admin] RBAC: Adding query filter params (role.id=57dcd2bc913849469a2c4364a91f53be, scope.project.id=4c3e52ada92f4695b6b642ba8afea967, user.id=5cc0fa63e96b476dad607e6c6449cc6e) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:44.365172 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bffbc0-2f70-42fe-91f8-c4dd08d1efe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:44.366587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bffbc0-2f70-42fe-91f8-c4dd08d1efe4 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:44.372541 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 109/223] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:05:44 2022] GET /identity/v3/role_assignments?user.id=5cc0fa63e96b476dad607e6c6449cc6e&scope.project.id=4c3e52ada92f4695b6b642ba8afea967&role.id=57dcd2bc913849469a2c4364a91f53be => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:45.803040 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb1649-af71-48f8-9230-1b196744ae76 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:45.803556 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb1649-af71-48f8-9230-1b196744ae76 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:45.803556 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb1649-af71-48f8-9230-1b196744ae76 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:45.805698 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 115/224] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:45.810670 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1c99-a3e6-4fc9-84a0-36344140fa76 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:45.811090 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1c99-a3e6-4fc9-84a0-36344140fa76 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:45.811477 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1c99-a3e6-4fc9-84a0-36344140fa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:45.812576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823319-ff69-45b4-9b63-cd2837dcd28a None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:45.812865 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823319-ff69-45b4-9b63-cd2837dcd28a None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:45.813140 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823319-ff69-45b4-9b63-cd2837dcd28a None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:45.814526 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 116/225] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:05:45.819538 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc28e53-b60e-436a-8fc6-448f159779b0 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:45.819665 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc28e53-b60e-436a-8fc6-448f159779b0 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:45.819888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc28e53-b60e-436a-8fc6-448f159779b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:45.830935 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-4c3e1c99-a3e6-4fc9-84a0-36344140fa76 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:45.832108 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-4c3e1c99-a3e6-4fc9-84a0-36344140fa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:45.837684 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-dfc28e53-b60e-436a-8fc6-448f159779b0 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:45.838824 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-dfc28e53-b60e-436a-8fc6-448f159779b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:45.905113 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 110/226] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:45.908587 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 117/227] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 19:05:45.951980 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378d4a-35e8-45d0-9853-8967e49888ba None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:45.952240 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378d4a-35e8-45d0-9853-8967e49888ba None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:45.952479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31378d4a-35e8-45d0-9853-8967e49888ba None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:45.953947 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 111/228] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:45.958753 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af8dc-f5d8-4ed0-ba60-c250cb80d1b8 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:45.959038 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af8dc-f5d8-4ed0-ba60-c250cb80d1b8 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:45.959306 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705af8dc-f5d8-4ed0-ba60-c250cb80d1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:45.978320 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-705af8dc-f5d8-4ed0-ba60-c250cb80d1b8 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:45.979480 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-705af8dc-f5d8-4ed0-ba60-c250cb80d1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:45.997362 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:46.048849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 118/229] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:46.229107 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31378d4a-35e8-45d0-9853-8967e49888ba None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:46.234810 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705af8dc-f5d8-4ed0-ba60-c250cb80d1b8 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:46.255048 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:46.338907 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31378d4a-35e8-45d0-9853-8967e49888ba None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:46.348583 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705af8dc-f5d8-4ed0-ba60-c250cb80d1b8 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:46.376388 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7c3ab-e9ab-40f2-822c-c4281cbf7790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:46.377014 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7c3ab-e9ab-40f2-822c-c4281cbf7790 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:46.377293 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7c3ab-e9ab-40f2-822c-c4281cbf7790 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:46.377559 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7c3ab-e9ab-40f2-822c-c4281cbf7790 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:46.378661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7c3ab-e9ab-40f2-822c-c4281cbf7790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:46.380089 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7c3ab-e9ab-40f2-822c-c4281cbf7790 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:46.381720 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 112/230] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:46.382422 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7c3ab-e9ab-40f2-822c-c4281cbf7790 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:46.388957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1d9a4-4007-4c06-8b78-016074f7d295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:46.389584 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1d9a4-4007-4c06-8b78-016074f7d295 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:46.389857 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1d9a4-4007-4c06-8b78-016074f7d295 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:46.390124 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1d9a4-4007-4c06-8b78-016074f7d295 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:46.400801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1d9a4-4007-4c06-8b78-016074f7d295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-84b1d9a4-4007-4c06-8b78-016074f7d295 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:46.405635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:46.406572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:46.407353 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 119/231] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:05:46.409215 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1d9a4-4007-4c06-8b78-016074f7d295 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:46.425846 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:46.472961 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:46.483105 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7c3ab-e9ab-40f2-822c-c4281cbf7790 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:46.516707 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1d9a4-4007-4c06-8b78-016074f7d295 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:46.517160 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e7fa8-b147-45cd-89bc-fcf128735eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:46.517785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e7fa8-b147-45cd-89bc-fcf128735eaa None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:46.518062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e7fa8-b147-45cd-89bc-fcf128735eaa None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:46.518326 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e7fa8-b147-45cd-89bc-fcf128735eaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:46.530021 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e7fa8-b147-45cd-89bc-fcf128735eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-473e7fa8-b147-45cd-89bc-fcf128735eaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:46.535277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:46.536135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:46.536973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 113/232] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:46.541168 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e7fa8-b147-45cd-89bc-fcf128735eaa None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:46.551872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154c006-638c-42cb-8122-d0620d0ee6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:46.552509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154c006-638c-42cb-8122-d0620d0ee6c4 None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:46.552786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154c006-638c-42cb-8122-d0620d0ee6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:46.553053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154c006-638c-42cb-8122-d0620d0ee6c4 None admin] PATH_INFO: `/v3/groups` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:46.553673 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154c006-638c-42cb-8122-d0620d0ee6c4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:46.555216 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154c006-638c-42cb-8122-d0620d0ee6c4 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:46.571329 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 120/233] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Oct 20 19:05:46 2022] POST /identity/v3/groups => generated 229 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:46.571997 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154c006-638c-42cb-8122-d0620d0ee6c4 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:46.662199 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:46.666286 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e7fa8-b147-45cd-89bc-fcf128735eaa None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:46.703830 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154c006-638c-42cb-8122-d0620d0ee6c4 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:46.705705 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0829c7-9d55-4ebe-9eec-5fb5f05c2f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:46.706326 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0829c7-9d55-4ebe-9eec-5fb5f05c2f7c None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:46.706604 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0829c7-9d55-4ebe-9eec-5fb5f05c2f7c None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:46.706878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0829c7-9d55-4ebe-9eec-5fb5f05c2f7c None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:46.707557 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0829c7-9d55-4ebe-9eec-5fb5f05c2f7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:46.707860 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0829c7-9d55-4ebe-9eec-5fb5f05c2f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:46.709317 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0829c7-9d55-4ebe-9eec-5fb5f05c2f7c None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:46.723830 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 114/234] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:46.724772 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0829c7-9d55-4ebe-9eec-5fb5f05c2f7c None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:46.744435 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:46.744871 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54552446-e9bb-4249-a879-bec5c29a29a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:46.745650 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54552446-e9bb-4249-a879-bec5c29a29a3 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:46.745930 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54552446-e9bb-4249-a879-bec5c29a29a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:46.746200 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54552446-e9bb-4249-a879-bec5c29a29a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:46.746869 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54552446-e9bb-4249-a879-bec5c29a29a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:46.747198 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54552446-e9bb-4249-a879-bec5c29a29a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:46.748586 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54552446-e9bb-4249-a879-bec5c29a29a3 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:46.759519 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 121/235] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:46.765254 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54552446-e9bb-4249-a879-bec5c29a29a3 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:46.846134 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0829c7-9d55-4ebe-9eec-5fb5f05c2f7c None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:46.884034 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdaa12-346b-4239-a682-1d59ea1b3a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:46.884711 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdaa12-346b-4239-a682-1d59ea1b3a74 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:46.884997 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdaa12-346b-4239-a682-1d59ea1b3a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:46.885270 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdaa12-346b-4239-a682-1d59ea1b3a74 None admin] PATH_INFO: `/v3/users/4b41e2a0fe1b47fb8bc5b8b41eed99d5` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:46.890617 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54552446-e9bb-4249-a879-bec5c29a29a3 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:46.901603 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdaa12-346b-4239-a682-1d59ea1b3a74 None admin] RBAC: Authorizing `identity:get_user(user_id=4b41e2a0fe1b47fb8bc5b8b41eed99d5)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:46.903373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdaa12-346b-4239-a682-1d59ea1b3a74 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:46.909897 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 115/236] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:46 2022] GET /identity/v3/users/4b41e2a0fe1b47fb8bc5b8b41eed99d5 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:46.910981 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdaa12-346b-4239-a682-1d59ea1b3a74 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:46.926333 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6ecf0-600e-4d5d-b63a-f62364ae3423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:46.926958 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6ecf0-600e-4d5d-b63a-f62364ae3423 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:46.927235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6ecf0-600e-4d5d-b63a-f62364ae3423 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:46.927743 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6ecf0-600e-4d5d-b63a-f62364ae3423 None admin] PATH_INFO: `/v3/users/7b4e3528f6bf44d983fc42a3fe788fb0` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:46.928653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6ecf0-600e-4d5d-b63a-f62364ae3423 None admin] RBAC: Authorizing `identity:get_user(user_id=7b4e3528f6bf44d983fc42a3fe788fb0)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:46.931099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6ecf0-600e-4d5d-b63a-f62364ae3423 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:46.933005 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 122/237] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:46 2022] GET /identity/v3/users/7b4e3528f6bf44d983fc42a3fe788fb0 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:46.938262 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6ecf0-600e-4d5d-b63a-f62364ae3423 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:46.942620 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:46.989009 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:47.021727 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdaa12-346b-4239-a682-1d59ea1b3a74 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:47.048080 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6ecf0-600e-4d5d-b63a-f62364ae3423 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:47.059116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91761cf-3b05-450a-983e-40fbf8c80351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:47.059721 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91761cf-3b05-450a-983e-40fbf8c80351 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:47.060336 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91761cf-3b05-450a-983e-40fbf8c80351 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:47.060616 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91761cf-3b05-450a-983e-40fbf8c80351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:47.061505 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91761cf-3b05-450a-983e-40fbf8c80351 None admin] RBAC: Adding query filter params (role.id=57dcd2bc913849469a2c4364a91f53be, user.id=4b41e2a0fe1b47fb8bc5b8b41eed99d5, scope.system=all) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:47.061814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91761cf-3b05-450a-983e-40fbf8c80351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:47.063266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91761cf-3b05-450a-983e-40fbf8c80351 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:47.068328 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 116/238] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Oct 20 19:05:46 2022] GET /identity/v3/role_assignments?user.id=4b41e2a0fe1b47fb8bc5b8b41eed99d5&scope.system=all&role.id=57dcd2bc913849469a2c4364a91f53be => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:47.094346 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27075f-9494-4088-b738-f7e5d12c18c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:47.095032 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27075f-9494-4088-b738-f7e5d12c18c2 None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:47.095313 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27075f-9494-4088-b738-f7e5d12c18c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:47.095656 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27075f-9494-4088-b738-f7e5d12c18c2 None admin] PATH_INFO: `/v3/system/users/7b4e3528f6bf44d983fc42a3fe788fb0/roles/bbdc52113ece4f3da0ee37763b27b9e5` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:47.097230 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27075f-9494-4088-b738-f7e5d12c18c2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7b4e3528f6bf44d983fc42a3fe788fb0, role_id=bbdc52113ece4f3da0ee37763b27b9e5)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:47.098794 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27075f-9494-4088-b738-f7e5d12c18c2 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:47.111876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 123/239] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Oct 20 19:05:46 2022] PUT /identity/v3/system/users/7b4e3528f6bf44d983fc42a3fe788fb0/roles/bbdc52113ece4f3da0ee37763b27b9e5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 19:05:49.020651 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25a5bb-0b78-4fde-a2d8-bf1149e85222 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:49.021142 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25a5bb-0b78-4fde-a2d8-bf1149e85222 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:49.021142 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25a5bb-0b78-4fde-a2d8-bf1149e85222 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:49.022498 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 117/240] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:49.027641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d4be6-7fd3-4a6b-a0a8-d1bc8be715dd None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:49.028033 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d4be6-7fd3-4a6b-a0a8-d1bc8be715dd None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:49.028188 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d4be6-7fd3-4a6b-a0a8-d1bc8be715dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:49.048170 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-2a3d4be6-7fd3-4a6b-a0a8-d1bc8be715dd None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:49.049429 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-2a3d4be6-7fd3-4a6b-a0a8-d1bc8be715dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:49.116828 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:49.132439 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 124/241] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:49.447482 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25a5bb-0b78-4fde-a2d8-bf1149e85222 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:49.481788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112cb60-77d8-41de-b673-a4f313a79b5f None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:49.482074 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112cb60-77d8-41de-b673-a4f313a79b5f None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:49.482346 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112cb60-77d8-41de-b673-a4f313a79b5f None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:49.483820 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 125/242] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:49.488753 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749cc05-425b-4f71-81f9-c09f3dde5d52 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:49.489037 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749cc05-425b-4f71-81f9-c09f3dde5d52 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:49.489325 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749cc05-425b-4f71-81f9-c09f3dde5d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:49.508934 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-e749cc05-425b-4f71-81f9-c09f3dde5d52 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:49.510119 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-e749cc05-425b-4f71-81f9-c09f3dde5d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:49.553405 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25a5bb-0b78-4fde-a2d8-bf1149e85222 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:49.582130 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 126/243] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 19:05:49.591076 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3885c3-8c74-4fb3-81d5-fe2b055882e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:49.591895 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3885c3-8c74-4fb3-81d5-fe2b055882e9 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:49.592336 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3885c3-8c74-4fb3-81d5-fe2b055882e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:49.592745 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3885c3-8c74-4fb3-81d5-fe2b055882e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:49.593958 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3885c3-8c74-4fb3-81d5-fe2b055882e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:49.595540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3885c3-8c74-4fb3-81d5-fe2b055882e9 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:49.597544 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 118/244] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:05:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:49.603584 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3885c3-8c74-4fb3-81d5-fe2b055882e9 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:49.604177 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7238-4b3b-4b67-a947-847700d7b057 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:49.604491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7238-4b3b-4b67-a947-847700d7b057 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:49.604766 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7238-4b3b-4b67-a947-847700d7b057 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:49.606216 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 127/245] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:49.608449 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:49.611139 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e8d8b-a7e4-482a-abdf-cd853990985e None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:49.611454 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e8d8b-a7e4-482a-abdf-cd853990985e None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:49.611718 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e8d8b-a7e4-482a-abdf-cd853990985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:49.629430 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-cc1e8d8b-a7e4-482a-abdf-cd853990985e None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:49.630612 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-cc1e8d8b-a7e4-482a-abdf-cd853990985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:49.705490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 128/246] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:49.711460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3885c3-8c74-4fb3-81d5-fe2b055882e9 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:49.745475 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9f2e8-3e50-4f3a-b4bd-b408d1a2f634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:49.746411 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9f2e8-3e50-4f3a-b4bd-b408d1a2f634 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:49.746688 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9f2e8-3e50-4f3a-b4bd-b408d1a2f634 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:49.746952 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9f2e8-3e50-4f3a-b4bd-b408d1a2f634 None admin] PATH_INFO: `/v3/groups` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:49.747568 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9f2e8-3e50-4f3a-b4bd-b408d1a2f634 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:49.749015 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9f2e8-3e50-4f3a-b4bd-b408d1a2f634 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:49.765766 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 119/247] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Oct 20 19:05:49 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:05:49.910568 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e8d8b-a7e4-482a-abdf-cd853990985e None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:49.974998 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:50.019668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e8d8b-a7e4-482a-abdf-cd853990985e None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:50.031535 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9f2e8-3e50-4f3a-b4bd-b408d1a2f634 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:50.059478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045d6bc-b37f-42dc-a08f-05cec5a3f309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:50.060111 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045d6bc-b37f-42dc-a08f-05cec5a3f309 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:50.060415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045d6bc-b37f-42dc-a08f-05cec5a3f309 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:50.060682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045d6bc-b37f-42dc-a08f-05cec5a3f309 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:50.071854 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045d6bc-b37f-42dc-a08f-05cec5a3f309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-7045d6bc-b37f-42dc-a08f-05cec5a3f309 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:50.076767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:50.077674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:50.078491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:50.080422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 129/248] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:50.083675 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045d6bc-b37f-42dc-a08f-05cec5a3f309 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:50.106824 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:50.168700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9f2e8-3e50-4f3a-b4bd-b408d1a2f634 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:50.216060 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045d6bc-b37f-42dc-a08f-05cec5a3f309 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:50.218218 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696316c-212c-4e2f-90bb-96b4feef6199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:50.219700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696316c-212c-4e2f-90bb-96b4feef6199 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:50.219987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696316c-212c-4e2f-90bb-96b4feef6199 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:50.220293 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696316c-212c-4e2f-90bb-96b4feef6199 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:50.234744 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696316c-212c-4e2f-90bb-96b4feef6199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:50.239316 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-4696316c-212c-4e2f-90bb-96b4feef6199 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:50.240032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:50.240949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:50.241749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 120/249] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:50.247382 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696316c-212c-4e2f-90bb-96b4feef6199 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:50.263147 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3113a-4cb1-448b-8989-29ed92960cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:50.264006 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3113a-4cb1-448b-8989-29ed92960cd5 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:50.264301 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3113a-4cb1-448b-8989-29ed92960cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:50.264585 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3113a-4cb1-448b-8989-29ed92960cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:50.265251 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3113a-4cb1-448b-8989-29ed92960cd5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:50.265551 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3113a-4cb1-448b-8989-29ed92960cd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:50.266926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3113a-4cb1-448b-8989-29ed92960cd5 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:50.276107 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 130/250] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:50.281162 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3113a-4cb1-448b-8989-29ed92960cd5 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:50.388075 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696316c-212c-4e2f-90bb-96b4feef6199 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:50.414839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:50.431220 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5cb45-b115-4526-b5ca-4791f9a0d878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:50.432222 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5cb45-b115-4526-b5ca-4791f9a0d878 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:50.432531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5cb45-b115-4526-b5ca-4791f9a0d878 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:50.432799 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5cb45-b115-4526-b5ca-4791f9a0d878 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:50.433463 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5cb45-b115-4526-b5ca-4791f9a0d878 None admin] RBAC: Adding query filter params (name=member) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:50.433763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5cb45-b115-4526-b5ca-4791f9a0d878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:50.439659 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3113a-4cb1-448b-8989-29ed92960cd5 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:50.441160 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5cb45-b115-4526-b5ca-4791f9a0d878 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:50.452853 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 121/251] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:50.458599 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5cb45-b115-4526-b5ca-4791f9a0d878 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:50.488067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9762a-05fc-4f9b-b64d-ef01a40547e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:50.488675 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9762a-05fc-4f9b-b64d-ef01a40547e1 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:50.488956 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9762a-05fc-4f9b-b64d-ef01a40547e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:50.489225 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9762a-05fc-4f9b-b64d-ef01a40547e1 None admin] PATH_INFO: `/v3/users/4b41e2a0fe1b47fb8bc5b8b41eed99d5` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:50.490372 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9762a-05fc-4f9b-b64d-ef01a40547e1 None admin] RBAC: Authorizing `identity:get_user(user_id=4b41e2a0fe1b47fb8bc5b8b41eed99d5)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:50.491829 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9762a-05fc-4f9b-b64d-ef01a40547e1 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:50.494963 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 131/252] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:50 2022] GET /identity/v3/users/4b41e2a0fe1b47fb8bc5b8b41eed99d5 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:50.501625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9762a-05fc-4f9b-b64d-ef01a40547e1 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:50.572756 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:50.585437 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5cb45-b115-4526-b5ca-4791f9a0d878 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:50.635065 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff23d9e-6f80-47d0-8659-73abe10d02e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:50.636091 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff23d9e-6f80-47d0-8659-73abe10d02e9 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:50.636512 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff23d9e-6f80-47d0-8659-73abe10d02e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:50.636786 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff23d9e-6f80-47d0-8659-73abe10d02e9 None admin] PATH_INFO: `/v3/users/7b4e3528f6bf44d983fc42a3fe788fb0` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:50.638028 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff23d9e-6f80-47d0-8659-73abe10d02e9 None admin] RBAC: Authorizing `identity:get_user(user_id=7b4e3528f6bf44d983fc42a3fe788fb0)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:50.639572 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff23d9e-6f80-47d0-8659-73abe10d02e9 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:50.641709 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 122/253] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:50 2022] GET /identity/v3/users/7b4e3528f6bf44d983fc42a3fe788fb0 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:50.647741 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff23d9e-6f80-47d0-8659-73abe10d02e9 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:50.654139 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9762a-05fc-4f9b-b64d-ef01a40547e1 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:50.707208 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24b471-5eef-4b94-b930-ea7858badce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:50.708257 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24b471-5eef-4b94-b930-ea7858badce5 None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:50.708561 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24b471-5eef-4b94-b930-ea7858badce5 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:50.708835 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24b471-5eef-4b94-b930-ea7858badce5 None admin] PATH_INFO: `/v3/system/users/4b41e2a0fe1b47fb8bc5b8b41eed99d5/roles/57dcd2bc913849469a2c4364a91f53be` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:50.710499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24b471-5eef-4b94-b930-ea7858badce5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4b41e2a0fe1b47fb8bc5b8b41eed99d5, role_id=57dcd2bc913849469a2c4364a91f53be)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:50.713244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24b471-5eef-4b94-b930-ea7858badce5 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:50.723650 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:50.726468 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 132/254] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Oct 20 19:05:50 2022] PUT /identity/v3/system/users/4b41e2a0fe1b47fb8bc5b8b41eed99d5/roles/57dcd2bc913849469a2c4364a91f53be => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:05:50.783168 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff23d9e-6f80-47d0-8659-73abe10d02e9 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:50.822944 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24254f7f-d486-4021-8881-1a99bd49fa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:50.823558 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254f7f-d486-4021-8881-1a99bd49fa2f None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:50.823836 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254f7f-d486-4021-8881-1a99bd49fa2f None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:50.824106 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24254f7f-d486-4021-8881-1a99bd49fa2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:50.824879 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24254f7f-d486-4021-8881-1a99bd49fa2f None admin] RBAC: Adding query filter params (role.id=bbdc52113ece4f3da0ee37763b27b9e5, user.id=7b4e3528f6bf44d983fc42a3fe788fb0, scope.system=all) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:50.825240 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24254f7f-d486-4021-8881-1a99bd49fa2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:50.826707 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24254f7f-d486-4021-8881-1a99bd49fa2f None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:50.841047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 123/255] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Oct 20 19:05:50 2022] GET /identity/v3/role_assignments?user.id=7b4e3528f6bf44d983fc42a3fe788fb0&scope.system=all&role.id=bbdc52113ece4f3da0ee37763b27b9e5 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:52.534797 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b727de1-4083-48dc-9b2f-f9e2a39abaf4 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:52.535342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b727de1-4083-48dc-9b2f-f9e2a39abaf4 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:52.535342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b727de1-4083-48dc-9b2f-f9e2a39abaf4 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:52.536966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 133/256] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:52.543812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3a05-e0cd-41d1-a04e-38f868cd11a2 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:52.544301 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3a05-e0cd-41d1-a04e-38f868cd11a2 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:52.544403 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f3a05-e0cd-41d1-a04e-38f868cd11a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:52.570594 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-338f3a05-e0cd-41d1-a04e-38f868cd11a2 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:52.571902 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-338f3a05-e0cd-41d1-a04e-38f868cd11a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:52.657445 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 124/257] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 20 19:05:53.305930 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b727de1-4083-48dc-9b2f-f9e2a39abaf4 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:53.319065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b727de1-4083-48dc-9b2f-f9e2a39abaf4 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:53.324209 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b6795-495c-4ad6-bf3a-9217211480b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:53.324857 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b6795-495c-4ad6-bf3a-9217211480b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:53.325128 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b6795-495c-4ad6-bf3a-9217211480b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:53.325396 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b6795-495c-4ad6-bf3a-9217211480b0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:53.340120 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b6795-495c-4ad6-bf3a-9217211480b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-939b6795-495c-4ad6-bf3a-9217211480b0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:53.348646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:53.349566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:53.350412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 134/258] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Oct 20 19:05:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:53.356758 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f3a05-e0cd-41d1-a04e-38f868cd11a2 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:53.371895 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f3a05-e0cd-41d1-a04e-38f868cd11a2 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:53.377442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a398-2e37-4054-90ef-1b83e95d0106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:53.378126 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a398-2e37-4054-90ef-1b83e95d0106 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:53.378431 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a398-2e37-4054-90ef-1b83e95d0106 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:53.378738 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0a398-2e37-4054-90ef-1b83e95d0106 admin admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:53.379408 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0a398-2e37-4054-90ef-1b83e95d0106 admin admin] RBAC: Adding query filter params (name=member) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:53.379737 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0a398-2e37-4054-90ef-1b83e95d0106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:53.381596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: WARNING py.warnings [None req-ecd0a398-2e37-4054-90ef-1b83e95d0106 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:05:53.381596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: warnings.warn(msg) Oct 20 19:05:53.381596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: Oct 20 19:05:53.383229 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0a398-2e37-4054-90ef-1b83e95d0106 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:53.401242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 125/259] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 19:05:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:53.406738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b6795-495c-4ad6-bf3a-9217211480b0 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:53.421699 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b6795-495c-4ad6-bf3a-9217211480b0 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:53.431946 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ab9ee-1fa9-47df-a805-2f365d097a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:53.432601 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab9ee-1fa9-47df-a805-2f365d097a56 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:53.432875 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab9ee-1fa9-47df-a805-2f365d097a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:53.433146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab9ee-1fa9-47df-a805-2f365d097a56 admin admin] PATH_INFO: `/v3/groups/57de530b641c4521b5aefd0bb45fb380` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:53.443111 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ab9ee-1fa9-47df-a805-2f365d097a56 admin admin] RBAC: Authorizing `identity:get_group(group_id=57de530b641c4521b5aefd0bb45fb380)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:53.445424 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: WARNING py.warnings [None req-f82ab9ee-1fa9-47df-a805-2f365d097a56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:05:53.445424 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: warnings.warn(msg) Oct 20 19:05:53.445424 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: Oct 20 19:05:53.446665 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ab9ee-1fa9-47df-a805-2f365d097a56 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:53.448338 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 135/260] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Oct 20 19:05:53 2022] GET /identity/v3/groups/57de530b641c4521b5aefd0bb45fb380 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:53.453934 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a398-2e37-4054-90ef-1b83e95d0106 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:53.470670 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0a398-2e37-4054-90ef-1b83e95d0106 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:53.476672 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e37494-97c9-4ded-b4be-46451f5550fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:53.477447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37494-97c9-4ded-b4be-46451f5550fb admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:53.477731 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37494-97c9-4ded-b4be-46451f5550fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:53.478004 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37494-97c9-4ded-b4be-46451f5550fb admin admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:53.479144 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e37494-97c9-4ded-b4be-46451f5550fb admin admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:53.481248 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e37494-97c9-4ded-b4be-46451f5550fb admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:53.483201 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 126/261] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 19:05:53 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:53.488952 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ab9ee-1fa9-47df-a805-2f365d097a56 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:53.501403 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ab9ee-1fa9-47df-a805-2f365d097a56 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:53.507145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46da6d-b3af-474c-b30b-de6142e9784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:53.508345 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46da6d-b3af-474c-b30b-de6142e9784e admin admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:53.508623 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46da6d-b3af-474c-b30b-de6142e9784e admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:53.508892 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46da6d-b3af-474c-b30b-de6142e9784e admin admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/groups/57de530b641c4521b5aefd0bb45fb380/roles/bbdc52113ece4f3da0ee37763b27b9e5` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:53.513514 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46da6d-b3af-474c-b30b-de6142e9784e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c71f771e47847d7a5d6f6da015ee47e, group_id=57de530b641c4521b5aefd0bb45fb380, role_id=bbdc52113ece4f3da0ee37763b27b9e5)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:53.514532 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: WARNING py.warnings [None req-9c46da6d-b3af-474c-b30b-de6142e9784e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:05:53.514532 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: warnings.warn(msg) Oct 20 19:05:53.514532 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: Oct 20 19:05:53.516514 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46da6d-b3af-474c-b30b-de6142e9784e admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:53.547897 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 136/262] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Oct 20 19:05:53 2022] PUT /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/groups/57de530b641c4521b5aefd0bb45fb380/roles/bbdc52113ece4f3da0ee37763b27b9e5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:05:53.555651 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45564-d82c-418b-832a-0973fae2c30a None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:53.556393 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45564-d82c-418b-832a-0973fae2c30a None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:53.556393 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a45564-d82c-418b-832a-0973fae2c30a None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:53.557704 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 127/263] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:53.564358 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57f911-c948-4e05-8e32-72787c3592d3 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:53.564642 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57f911-c948-4e05-8e32-72787c3592d3 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:53.564902 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57f911-c948-4e05-8e32-72787c3592d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:53.589681 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-8c57f911-c948-4e05-8e32-72787c3592d3 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:53.590894 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-8c57f911-c948-4e05-8e32-72787c3592d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:53.671686 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 137/264] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 19:05:54.079081 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ae35-c1a1-4aaf-9747-44a56aad0910 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.079487 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ae35-c1a1-4aaf-9747-44a56aad0910 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.079658 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ae35-c1a1-4aaf-9747-44a56aad0910 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.081240 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 128/265] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:54.086630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f6c4a-fdca-4840-aa7a-d381bc118509 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.086915 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f6c4a-fdca-4840-aa7a-d381bc118509 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.087191 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f6c4a-fdca-4840-aa7a-d381bc118509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.111301 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-ff4f6c4a-fdca-4840-aa7a-d381bc118509 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:54.112532 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-ff4f6c4a-fdca-4840-aa7a-d381bc118509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:54.126614 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 138/266] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 19:05:54.309308 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316ae35-c1a1-4aaf-9747-44a56aad0910 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:54.322144 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316ae35-c1a1-4aaf-9747-44a56aad0910 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:54.330910 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d3e1-2ac8-46cf-8fd6-8301a07e50bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:54.331473 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d3e1-2ac8-46cf-8fd6-8301a07e50bf admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.331795 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d3e1-2ac8-46cf-8fd6-8301a07e50bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.332111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d3e1-2ac8-46cf-8fd6-8301a07e50bf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.344259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3d3e1-2ac8-46cf-8fd6-8301a07e50bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-16a3d3e1-2ac8-46cf-8fd6-8301a07e50bf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:54.349624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:54.352187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:54.354242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 129/267] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Oct 20 19:05:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:54.357485 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f6c4a-fdca-4840-aa7a-d381bc118509 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:54.367552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f6c4a-fdca-4840-aa7a-d381bc118509 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:54.376072 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111efe1c-7207-44f4-ac3a-fd52d1f665ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:54.376761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111efe1c-7207-44f4-ac3a-fd52d1f665ca admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.377031 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111efe1c-7207-44f4-ac3a-fd52d1f665ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.377298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111efe1c-7207-44f4-ac3a-fd52d1f665ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.377959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111efe1c-7207-44f4-ac3a-fd52d1f665ca admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:54.378249 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111efe1c-7207-44f4-ac3a-fd52d1f665ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:54.379242 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: WARNING py.warnings [None req-111efe1c-7207-44f4-ac3a-fd52d1f665ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:05:54.379242 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: warnings.warn(msg) Oct 20 19:05:54.379242 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: Oct 20 19:05:54.380122 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111efe1c-7207-44f4-ac3a-fd52d1f665ca admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:54.390005 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 139/268] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Oct 20 19:05:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:54.395116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d3e1-2ac8-46cf-8fd6-8301a07e50bf admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:54.407807 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d3e1-2ac8-46cf-8fd6-8301a07e50bf admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:54.412419 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0132f33-d041-490b-a8ec-74c789762d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:54.413099 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0132f33-d041-490b-a8ec-74c789762d98 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.413427 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0132f33-d041-490b-a8ec-74c789762d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.413791 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0132f33-d041-490b-a8ec-74c789762d98 admin admin] PATH_INFO: `/v3/groups/57de530b641c4521b5aefd0bb45fb380` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.415081 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0132f33-d041-490b-a8ec-74c789762d98 admin admin] RBAC: Authorizing `identity:get_group(group_id=57de530b641c4521b5aefd0bb45fb380)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:54.416154 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: WARNING py.warnings [None req-a0132f33-d041-490b-a8ec-74c789762d98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:05:54.416154 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: warnings.warn(msg) Oct 20 19:05:54.416154 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: Oct 20 19:05:54.417723 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0132f33-d041-490b-a8ec-74c789762d98 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:54.419374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 130/269] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Oct 20 19:05:54 2022] GET /identity/v3/groups/57de530b641c4521b5aefd0bb45fb380 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:54.423932 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cdf4a-3e45-4b80-812c-0a075316c495 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.424285 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cdf4a-3e45-4b80-812c-0a075316c495 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.424595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cdf4a-3e45-4b80-812c-0a075316c495 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.425911 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 140/270] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:54.426830 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0132f33-d041-490b-a8ec-74c789762d98 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:54.439458 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0132f33-d041-490b-a8ec-74c789762d98 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:54.444035 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5097fb8-6a2a-4fce-b551-b92125176ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:54.448824 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5097fb8-6a2a-4fce-b551-b92125176ceb admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.449100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5097fb8-6a2a-4fce-b551-b92125176ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.449366 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5097fb8-6a2a-4fce-b551-b92125176ceb admin admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.450602 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5097fb8-6a2a-4fce-b551-b92125176ceb admin admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:54.452862 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5097fb8-6a2a-4fce-b551-b92125176ceb admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:54.454642 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 131/271] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 19:05:54 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:54.458053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f1c56-4670-4107-87bd-0e9e96cd13f9 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.458332 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f1c56-4670-4107-87bd-0e9e96cd13f9 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.458601 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f1c56-4670-4107-87bd-0e9e96cd13f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.469973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5097fb8-6a2a-4fce-b551-b92125176ceb admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:54.490952 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5097fb8-6a2a-4fce-b551-b92125176ceb admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:54.492383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-f16f1c56-4670-4107-87bd-0e9e96cd13f9 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:54.494767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-f16f1c56-4670-4107-87bd-0e9e96cd13f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:54.499548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa15b64-915c-45f0-9ec9-6e921ed568a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:54.501646 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa15b64-915c-45f0-9ec9-6e921ed568a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.501917 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa15b64-915c-45f0-9ec9-6e921ed568a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.502185 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa15b64-915c-45f0-9ec9-6e921ed568a5 admin admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/groups/57de530b641c4521b5aefd0bb45fb380/roles/e399cea584ee4afd9e0dbad4959cd49c` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.502929 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:54.509695 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa15b64-915c-45f0-9ec9-6e921ed568a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c71f771e47847d7a5d6f6da015ee47e, group_id=57de530b641c4521b5aefd0bb45fb380, role_id=e399cea584ee4afd9e0dbad4959cd49c)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:54.513400 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: WARNING py.warnings [None req-daa15b64-915c-45f0-9ec9-6e921ed568a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:05:54.513400 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: warnings.warn(msg) Oct 20 19:05:54.513400 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: Oct 20 19:05:54.517532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa15b64-915c-45f0-9ec9-6e921ed568a5 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:54.546373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 132/272] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Oct 20 19:05:54 2022] PUT /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e/groups/57de530b641c4521b5aefd0bb45fb380/roles/e399cea584ee4afd9e0dbad4959cd49c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:05:54.599131 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 141/273] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 19:05:54.616326 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3151a-d57e-4a7e-af39-8d8e2d5df748 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.617499 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3151a-d57e-4a7e-af39-8d8e2d5df748 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.617791 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3151a-d57e-4a7e-af39-8d8e2d5df748 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.619709 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 133/274] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:54.629195 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180412b0-b883-44df-9348-7cffd463795c None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.629195 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180412b0-b883-44df-9348-7cffd463795c None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.629195 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180412b0-b883-44df-9348-7cffd463795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.653864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-180412b0-b883-44df-9348-7cffd463795c None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:54.657075 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-180412b0-b883-44df-9348-7cffd463795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:54.739441 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3151a-d57e-4a7e-af39-8d8e2d5df748 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:54.742717 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 142/275] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 19:05:54.755263 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3151a-d57e-4a7e-af39-8d8e2d5df748 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:54.762796 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18b91d-5e85-4a00-831a-3267e4e5fc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:54.763483 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b91d-5e85-4a00-831a-3267e4e5fc81 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.763811 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b91d-5e85-4a00-831a-3267e4e5fc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.764125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b91d-5e85-4a00-831a-3267e4e5fc81 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.774265 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:54.778359 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18b91d-5e85-4a00-831a-3267e4e5fc81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-db18b91d-5e85-4a00-831a-3267e4e5fc81 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:54.787205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:54.788398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:54.790111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:54.793447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 134/276] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Oct 20 19:05:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:54.799642 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180412b0-b883-44df-9348-7cffd463795c None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:54.814080 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180412b0-b883-44df-9348-7cffd463795c None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:54.824878 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbce28-e1f7-4fda-8151-9e97abc3de08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:54.825766 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbce28-e1f7-4fda-8151-9e97abc3de08 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.826220 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbce28-e1f7-4fda-8151-9e97abc3de08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.826634 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbce28-e1f7-4fda-8151-9e97abc3de08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.827460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbce28-e1f7-4fda-8151-9e97abc3de08 admin admin] RBAC: Adding query filter params (name=member) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:54.827909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbce28-e1f7-4fda-8151-9e97abc3de08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:54.829712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbce28-e1f7-4fda-8151-9e97abc3de08 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:54.844889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 143/277] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Oct 20 19:05:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:54.851716 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18b91d-5e85-4a00-831a-3267e4e5fc81 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:54.866320 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18b91d-5e85-4a00-831a-3267e4e5fc81 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:54.875719 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd1c6-4e41-4303-9b7a-ce6c07b6f6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:54.876389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd1c6-4e41-4303-9b7a-ce6c07b6f6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.876666 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd1c6-4e41-4303-9b7a-ce6c07b6f6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.876991 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd1c6-4e41-4303-9b7a-ce6c07b6f6c7 admin admin] PATH_INFO: `/v3/groups/57de530b641c4521b5aefd0bb45fb380` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.878375 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cd1c6-4e41-4303-9b7a-ce6c07b6f6c7 admin admin] RBAC: Authorizing `identity:get_group(group_id=57de530b641c4521b5aefd0bb45fb380)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:54.880481 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cd1c6-4e41-4303-9b7a-ce6c07b6f6c7 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:54.883074 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 135/278] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Oct 20 19:05:54 2022] GET /identity/v3/groups/57de530b641c4521b5aefd0bb45fb380 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:54.888816 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbce28-e1f7-4fda-8151-9e97abc3de08 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:54.905602 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbce28-e1f7-4fda-8151-9e97abc3de08 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:54.912707 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36709b50-a97d-480b-a9a7-05848b9ecd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:54.913344 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36709b50-a97d-480b-a9a7-05848b9ecd06 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.914292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36709b50-a97d-480b-a9a7-05848b9ecd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.914581 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36709b50-a97d-480b-a9a7-05848b9ecd06 admin admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.917287 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36709b50-a97d-480b-a9a7-05848b9ecd06 admin admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:54.919640 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36709b50-a97d-480b-a9a7-05848b9ecd06 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:54.921910 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 144/279] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 19:05:54 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:54.927184 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd1c6-4e41-4303-9b7a-ce6c07b6f6c7 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:54.941954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd1c6-4e41-4303-9b7a-ce6c07b6f6c7 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:54.947615 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c169ad-fa19-4509-b0bd-fc4c819c00ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:54.948285 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c169ad-fa19-4509-b0bd-fc4c819c00ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:54.948568 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c169ad-fa19-4509-b0bd-fc4c819c00ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:54.948835 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c169ad-fa19-4509-b0bd-fc4c819c00ba admin admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967/groups/57de530b641c4521b5aefd0bb45fb380/roles/bbdc52113ece4f3da0ee37763b27b9e5` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:54.950720 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c169ad-fa19-4509-b0bd-fc4c819c00ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3e52ada92f4695b6b642ba8afea967, group_id=57de530b641c4521b5aefd0bb45fb380, role_id=bbdc52113ece4f3da0ee37763b27b9e5)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:54.953396 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c169ad-fa19-4509-b0bd-fc4c819c00ba admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:54.981628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 136/280] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Oct 20 19:05:54 2022] PUT /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967/groups/57de530b641c4521b5aefd0bb45fb380/roles/bbdc52113ece4f3da0ee37763b27b9e5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 19:05:55.155444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36709b50-a97d-480b-a9a7-05848b9ecd06 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:55.222492 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c169ad-fa19-4509-b0bd-fc4c819c00ba admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:55.287067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:55.330985 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c169ad-fa19-4509-b0bd-fc4c819c00ba admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:55.333340 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36709b50-a97d-480b-a9a7-05848b9ecd06 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:55.337602 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca68c49-8361-48b9-85ef-39cf6966392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:55.338584 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68c49-8361-48b9-85ef-39cf6966392a admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:55.339060 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68c49-8361-48b9-85ef-39cf6966392a admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:55.339526 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca68c49-8361-48b9-85ef-39cf6966392a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:55.356155 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca68c49-8361-48b9-85ef-39cf6966392a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-aca68c49-8361-48b9-85ef-39cf6966392a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:55.363207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:55.364219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:55.365098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:55.368620 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 137/281] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Oct 20 19:05:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:05:55.375684 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca68c49-8361-48b9-85ef-39cf6966392a admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:55.389890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca68c49-8361-48b9-85ef-39cf6966392a admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:55.396065 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda054c-9d4a-4ccd-92cc-d31af4ac9d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:55.397126 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda054c-9d4a-4ccd-92cc-d31af4ac9d31 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:55.397881 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda054c-9d4a-4ccd-92cc-d31af4ac9d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:55.398354 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda054c-9d4a-4ccd-92cc-d31af4ac9d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:55.399219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda054c-9d4a-4ccd-92cc-d31af4ac9d31 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:55.399715 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda054c-9d4a-4ccd-92cc-d31af4ac9d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:55.402292 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda054c-9d4a-4ccd-92cc-d31af4ac9d31 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:55.412017 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 138/282] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Oct 20 19:05:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:55.418862 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda054c-9d4a-4ccd-92cc-d31af4ac9d31 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:55.431127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda054c-9d4a-4ccd-92cc-d31af4ac9d31 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:55.433577 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce938ce-8730-4610-8675-afe6cfed0356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:55.434214 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce938ce-8730-4610-8675-afe6cfed0356 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:55.434489 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce938ce-8730-4610-8675-afe6cfed0356 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:55.434756 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce938ce-8730-4610-8675-afe6cfed0356 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:55.437059 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743e9e2-7014-4c10-804c-9b5fcff3d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:55.437936 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743e9e2-7014-4c10-804c-9b5fcff3d99c admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:55.438410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743e9e2-7014-4c10-804c-9b5fcff3d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:55.438875 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743e9e2-7014-4c10-804c-9b5fcff3d99c admin admin] PATH_INFO: `/v3/groups/57de530b641c4521b5aefd0bb45fb380` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:55.440337 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743e9e2-7014-4c10-804c-9b5fcff3d99c admin admin] RBAC: Authorizing `identity:get_group(group_id=57de530b641c4521b5aefd0bb45fb380)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:55.443114 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743e9e2-7014-4c10-804c-9b5fcff3d99c admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:55.445851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 139/283] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Oct 20 19:05:55 2022] GET /identity/v3/groups/57de530b641c4521b5aefd0bb45fb380 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:55.452015 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743e9e2-7014-4c10-804c-9b5fcff3d99c admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:55.465228 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce938ce-8730-4610-8675-afe6cfed0356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:55.465801 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743e9e2-7014-4c10-804c-9b5fcff3d99c admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-8ce938ce-8730-4610-8675-afe6cfed0356 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:55.470761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:55.471687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:55.472500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 145/284] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:55.473895 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0835a-449d-499b-ac6c-03288598da32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:55.474820 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0835a-449d-499b-ac6c-03288598da32 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:55.475287 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0835a-449d-499b-ac6c-03288598da32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:55.475830 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0835a-449d-499b-ac6c-03288598da32 admin admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:55.478054 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0835a-449d-499b-ac6c-03288598da32 admin admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:55.478170 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce938ce-8730-4610-8675-afe6cfed0356 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:55.480678 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0835a-449d-499b-ac6c-03288598da32 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:55.482910 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 140/285] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 19:05:55 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:55.490662 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0835a-449d-499b-ac6c-03288598da32 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:55.502514 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0835a-449d-499b-ac6c-03288598da32 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:55.509458 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cb7d3-9668-4e6e-93e9-9c0ccba50579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:55.510416 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb7d3-9668-4e6e-93e9-9c0ccba50579 admin admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:55.510897 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb7d3-9668-4e6e-93e9-9c0ccba50579 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:55.511424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb7d3-9668-4e6e-93e9-9c0ccba50579 admin admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967/groups/57de530b641c4521b5aefd0bb45fb380/roles/e399cea584ee4afd9e0dbad4959cd49c` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:55.514149 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cb7d3-9668-4e6e-93e9-9c0ccba50579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3e52ada92f4695b6b642ba8afea967, group_id=57de530b641c4521b5aefd0bb45fb380, role_id=e399cea584ee4afd9e0dbad4959cd49c)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:55.517221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cb7d3-9668-4e6e-93e9-9c0ccba50579 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:55.535690 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 141/286] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Oct 20 19:05:55 2022] PUT /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967/groups/57de530b641c4521b5aefd0bb45fb380/roles/e399cea584ee4afd9e0dbad4959cd49c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 19:05:55.649292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce938ce-8730-4610-8675-afe6cfed0356 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:55.690528 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:55.698200 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf4ecb-cd79-4936-8f3a-0918510ac03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:55.699108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4ecb-cd79-4936-8f3a-0918510ac03e None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:55.699561 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4ecb-cd79-4936-8f3a-0918510ac03e None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:55.700058 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4ecb-cd79-4936-8f3a-0918510ac03e None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:55.701331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf4ecb-cd79-4936-8f3a-0918510ac03e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:55.701832 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf4ecb-cd79-4936-8f3a-0918510ac03e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:55.703519 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf4ecb-cd79-4936-8f3a-0918510ac03e None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:55.714286 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 146/287] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:55.719720 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cb7d3-9668-4e6e-93e9-9c0ccba50579 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:55.841667 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:55.851770 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cb7d3-9668-4e6e-93e9-9c0ccba50579 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:55.891260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5687c96-ed22-4f1c-a7eb-aa108f5d9b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:55.891882 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5687c96-ed22-4f1c-a7eb-aa108f5d9b1c None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:55.892157 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5687c96-ed22-4f1c-a7eb-aa108f5d9b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:55.892452 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5687c96-ed22-4f1c-a7eb-aa108f5d9b1c None admin] PATH_INFO: `/v3/users/4b41e2a0fe1b47fb8bc5b8b41eed99d5` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:55.893576 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5687c96-ed22-4f1c-a7eb-aa108f5d9b1c None admin] RBAC: Authorizing `identity:get_user(user_id=4b41e2a0fe1b47fb8bc5b8b41eed99d5)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:55.894997 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5687c96-ed22-4f1c-a7eb-aa108f5d9b1c None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:55.896595 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 142/288] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Oct 20 19:05:55 2022] GET /identity/v3/users/4b41e2a0fe1b47fb8bc5b8b41eed99d5 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:55.903219 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf4ecb-cd79-4936-8f3a-0918510ac03e None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:56.030755 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf4ecb-cd79-4936-8f3a-0918510ac03e None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:56.076697 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31565c-6bb0-4712-8afa-3c9d5d3795af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:56.077313 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31565c-6bb0-4712-8afa-3c9d5d3795af None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:56.077589 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31565c-6bb0-4712-8afa-3c9d5d3795af None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:56.077859 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31565c-6bb0-4712-8afa-3c9d5d3795af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:56.078592 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31565c-6bb0-4712-8afa-3c9d5d3795af None admin] RBAC: Adding query filter params (role.id=57dcd2bc913849469a2c4364a91f53be, user.id=4b41e2a0fe1b47fb8bc5b8b41eed99d5, scope.system=all) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:56.078898 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31565c-6bb0-4712-8afa-3c9d5d3795af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:56.079223 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dd9dc-be4e-4305-87a9-1db466e19f84 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:56.079529 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dd9dc-be4e-4305-87a9-1db466e19f84 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:56.079773 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dd9dc-be4e-4305-87a9-1db466e19f84 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:56.080378 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31565c-6bb0-4712-8afa-3c9d5d3795af None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:56.081384 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 143/289] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:56.086799 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256d5cf-3adf-4a92-8544-8c6cc130aaea None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:56.087077 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256d5cf-3adf-4a92-8544-8c6cc130aaea None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:56.087343 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256d5cf-3adf-4a92-8544-8c6cc130aaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:56.099988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 147/290] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Oct 20 19:05:55 2022] GET /identity/v3/role_assignments?user.id=4b41e2a0fe1b47fb8bc5b8b41eed99d5&scope.system=all&role.id=57dcd2bc913849469a2c4364a91f53be => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:56.130903 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-3256d5cf-3adf-4a92-8544-8c6cc130aaea None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:56.132164 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-3256d5cf-3adf-4a92-8544-8c6cc130aaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:56.255049 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 144/291] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 19:05:56.969867 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31565c-6bb0-4712-8afa-3c9d5d3795af None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:56.981756 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31565c-6bb0-4712-8afa-3c9d5d3795af None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:56.986515 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff6ce-8107-40f1-a4b3-1741b5af9a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:56.987443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff6ce-8107-40f1-a4b3-1741b5af9a02 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:56.987926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff6ce-8107-40f1-a4b3-1741b5af9a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:56.988443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff6ce-8107-40f1-a4b3-1741b5af9a02 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:57.000824 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ff6ce-8107-40f1-a4b3-1741b5af9a02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-839ff6ce-8107-40f1-a4b3-1741b5af9a02 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:57.006413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:57.007891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:05:57.008712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:57.010966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 148/292] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 19:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:57.016892 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256d5cf-3adf-4a92-8544-8c6cc130aaea None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:57.030366 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256d5cf-3adf-4a92-8544-8c6cc130aaea None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:57.042152 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fd9d2-7633-412c-977a-c7e0f0aecd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:57.042833 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fd9d2-7633-412c-977a-c7e0f0aecd63 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:57.043110 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fd9d2-7633-412c-977a-c7e0f0aecd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:57.043377 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fd9d2-7633-412c-977a-c7e0f0aecd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:57.044043 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fd9d2-7633-412c-977a-c7e0f0aecd63 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:57.044369 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fd9d2-7633-412c-977a-c7e0f0aecd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:57.045965 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fd9d2-7633-412c-977a-c7e0f0aecd63 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:57.066400 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 145/293] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Oct 20 19:05:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:57.072451 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff6ce-8107-40f1-a4b3-1741b5af9a02 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:57.089826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff6ce-8107-40f1-a4b3-1741b5af9a02 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:57.096173 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a13d1-4ce2-46c0-a136-f5140f4c8af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:57.096826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a13d1-4ce2-46c0-a136-f5140f4c8af0 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:57.097102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a13d1-4ce2-46c0-a136-f5140f4c8af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:57.097369 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a13d1-4ce2-46c0-a136-f5140f4c8af0 admin admin] PATH_INFO: `/v3/groups/99a1fcf2e4084661b5a972347548d3ed` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:57.106286 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a13d1-4ce2-46c0-a136-f5140f4c8af0 admin admin] RBAC: Authorizing `identity:get_group(group_id=99a1fcf2e4084661b5a972347548d3ed)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:57.108218 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a13d1-4ce2-46c0-a136-f5140f4c8af0 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:57.110218 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 149/294] 10.222.0.16 () {56 vars in 1201 bytes} [Thu Oct 20 19:05:57 2022] GET /identity/v3/groups/99a1fcf2e4084661b5a972347548d3ed => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:57.115655 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fd9d2-7633-412c-977a-c7e0f0aecd63 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:57.129690 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fd9d2-7633-412c-977a-c7e0f0aecd63 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:57.144929 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaf72e-a9ac-4fc0-83be-bf8c8aca5e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:57.145570 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf72e-a9ac-4fc0-83be-bf8c8aca5e04 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:57.145848 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf72e-a9ac-4fc0-83be-bf8c8aca5e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:57.146120 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaf72e-a9ac-4fc0-83be-bf8c8aca5e04 admin admin] PATH_INFO: `/v3/projects/fb75e3ae7a47470dbe383104be65755f` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:57.147276 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaf72e-a9ac-4fc0-83be-bf8c8aca5e04 admin admin] RBAC: Authorizing `identity:get_project(project_id=fb75e3ae7a47470dbe383104be65755f)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:57.149350 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaf72e-a9ac-4fc0-83be-bf8c8aca5e04 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:57.152236 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 146/295] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Oct 20 19:05:57 2022] GET /identity/v3/projects/fb75e3ae7a47470dbe383104be65755f => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:57.156985 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a13d1-4ce2-46c0-a136-f5140f4c8af0 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:57.169877 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a13d1-4ce2-46c0-a136-f5140f4c8af0 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:57.184913 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c10f9-b835-44a1-a59b-419da95556b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:57.185580 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c10f9-b835-44a1-a59b-419da95556b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:57.185860 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c10f9-b835-44a1-a59b-419da95556b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:57.186135 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c10f9-b835-44a1-a59b-419da95556b2 admin admin] PATH_INFO: `/v3/projects/fb75e3ae7a47470dbe383104be65755f/groups/99a1fcf2e4084661b5a972347548d3ed/roles/fde247f30afe4b81958b67c776cabec0` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:57.188151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c10f9-b835-44a1-a59b-419da95556b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb75e3ae7a47470dbe383104be65755f, group_id=99a1fcf2e4084661b5a972347548d3ed, role_id=fde247f30afe4b81958b67c776cabec0)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:57.190908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c10f9-b835-44a1-a59b-419da95556b2 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:57.214361 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 150/296] 10.222.0.16 () {58 vars in 1463 bytes} [Thu Oct 20 19:05:57 2022] PUT /identity/v3/projects/fb75e3ae7a47470dbe383104be65755f/groups/99a1fcf2e4084661b5a972347548d3ed/roles/fde247f30afe4b81958b67c776cabec0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:05:57.455959 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825251dc-f2e2-4c45-976f-276483897e81 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:57.456354 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825251dc-f2e2-4c45-976f-276483897e81 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:57.456562 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825251dc-f2e2-4c45-976f-276483897e81 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:57.458138 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 147/297] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:57.470239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddef14-2b97-4bf3-ad91-7b902899986a None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:57.470558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddef14-2b97-4bf3-ad91-7b902899986a None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:57.470785 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddef14-2b97-4bf3-ad91-7b902899986a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:57.495896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-54ddef14-2b97-4bf3-ad91-7b902899986a None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:57.497171 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-54ddef14-2b97-4bf3-ad91-7b902899986a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:57.523744 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:57.586748 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 151/298] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:57.928045 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825251dc-f2e2-4c45-976f-276483897e81 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:58.054694 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:58.064178 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825251dc-f2e2-4c45-976f-276483897e81 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:58.107892 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752dbb3-8680-46a3-bf88-a687a37dced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:58.108581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752dbb3-8680-46a3-bf88-a687a37dced5 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:58.108961 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752dbb3-8680-46a3-bf88-a687a37dced5 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:58.109235 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752dbb3-8680-46a3-bf88-a687a37dced5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:58.124606 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752dbb3-8680-46a3-bf88-a687a37dced5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-3752dbb3-8680-46a3-bf88-a687a37dced5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:58.129649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:58.130530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:58.131340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 148/299] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:58.137826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddef14-2b97-4bf3-ad91-7b902899986a None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:58.291409 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddef14-2b97-4bf3-ad91-7b902899986a None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:58.338256 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d570-15ca-49a8-8d06-1dc5b283380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:58.339232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d570-15ca-49a8-8d06-1dc5b283380f None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:58.339702 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d570-15ca-49a8-8d06-1dc5b283380f None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:58.340193 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d570-15ca-49a8-8d06-1dc5b283380f None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:58.341259 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d570-15ca-49a8-8d06-1dc5b283380f None admin] RBAC: Adding query filter params (name=member) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:58.341750 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d570-15ca-49a8-8d06-1dc5b283380f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:58.343292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d570-15ca-49a8-8d06-1dc5b283380f None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:58.356972 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 152/300] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:58.364184 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752dbb3-8680-46a3-bf88-a687a37dced5 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:58.367684 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9ed4-6af9-4619-87ee-ba08e4cfc229 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:58.368373 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9ed4-6af9-4619-87ee-ba08e4cfc229 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:58.368857 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef9ed4-6af9-4619-87ee-ba08e4cfc229 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:58.370972 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 153/301] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:58.378141 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596be13-037f-44cd-8173-8e959499adc1 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:58.378754 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596be13-037f-44cd-8173-8e959499adc1 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:58.379226 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596be13-037f-44cd-8173-8e959499adc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:58.412241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-5596be13-037f-44cd-8173-8e959499adc1 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:58.413618 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-5596be13-037f-44cd-8173-8e959499adc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:58.434615 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:58.542416 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 154/302] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:58.555036 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752dbb3-8680-46a3-bf88-a687a37dced5 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:58.598112 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd34f0-8863-469b-9636-1b6242f5313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:58.598717 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd34f0-8863-469b-9636-1b6242f5313c None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:58.598990 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd34f0-8863-469b-9636-1b6242f5313c None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:58.599253 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd34f0-8863-469b-9636-1b6242f5313c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:58.636135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:58.650765 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899fb8-7e6a-47a2-b1ee-78a9bd6633c8 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:58.651147 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899fb8-7e6a-47a2-b1ee-78a9bd6633c8 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:58.651295 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899fb8-7e6a-47a2-b1ee-78a9bd6633c8 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:58.654674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 155/303] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:58.661649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feea0af-07ef-4037-8b1d-57b70c62a0b0 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:58.662206 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feea0af-07ef-4037-8b1d-57b70c62a0b0 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:58.662670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feea0af-07ef-4037-8b1d-57b70c62a0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:58.699115 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-9feea0af-07ef-4037-8b1d-57b70c62a0b0 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:58.700372 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-9feea0af-07ef-4037-8b1d-57b70c62a0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:58.733892 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd34f0-8863-469b-9636-1b6242f5313c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:58.735390 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd34f0-8863-469b-9636-1b6242f5313c None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:58.803075 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 156/304] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:58.883514 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 149/305] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:05:58.889379 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feea0af-07ef-4037-8b1d-57b70c62a0b0 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:58.971963 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd34f0-8863-469b-9636-1b6242f5313c None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:58.972821 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:59.006429 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feea0af-07ef-4037-8b1d-57b70c62a0b0 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:59.046363 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cf21a-d2fe-45ce-919f-7b050a3b56f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:59.047092 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cf21a-d2fe-45ce-919f-7b050a3b56f2 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:59.047473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cf21a-d2fe-45ce-919f-7b050a3b56f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:59.047810 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cf21a-d2fe-45ce-919f-7b050a3b56f2 None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:59.049034 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cf21a-d2fe-45ce-919f-7b050a3b56f2 None admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:59.050534 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cf21a-d2fe-45ce-919f-7b050a3b56f2 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:59.054448 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 157/306] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:05:58 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:59.065226 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:59.073095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cf21a-d2fe-45ce-919f-7b050a3b56f2 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:59.144906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd34f0-8863-469b-9636-1b6242f5313c None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:59.203376 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3c652-3fe9-4379-a51f-9f2e96f42812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:59.204324 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3c652-3fe9-4379-a51f-9f2e96f42812 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:59.205185 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3c652-3fe9-4379-a51f-9f2e96f42812 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:59.205820 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3c652-3fe9-4379-a51f-9f2e96f42812 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:59.216070 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cf21a-d2fe-45ce-919f-7b050a3b56f2 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:59.230487 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3c652-3fe9-4379-a51f-9f2e96f42812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-8af3c652-3fe9-4379-a51f-9f2e96f42812 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:59.239575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:59.240540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:05:59.241924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:05:59.245843 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 150/307] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:05:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:59.251739 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3c652-3fe9-4379-a51f-9f2e96f42812 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:59.280595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e1045-0c93-4b48-8bfb-c4039c88773e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:59.281639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e1045-0c93-4b48-8bfb-c4039c88773e None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:59.282190 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e1045-0c93-4b48-8bfb-c4039c88773e None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:59.282614 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e1045-0c93-4b48-8bfb-c4039c88773e None admin] PATH_INFO: `/v3/groups/57de530b641c4521b5aefd0bb45fb380` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:59.283933 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e1045-0c93-4b48-8bfb-c4039c88773e None admin] RBAC: Authorizing `identity:get_group(group_id=57de530b641c4521b5aefd0bb45fb380)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:59.286544 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e1045-0c93-4b48-8bfb-c4039c88773e None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:59.289322 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 158/308] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Oct 20 19:05:59 2022] GET /identity/v3/groups/57de530b641c4521b5aefd0bb45fb380 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:59.294352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168265-fbc6-4ef6-8422-a8e3a8ea2e06 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:59.295841 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168265-fbc6-4ef6-8422-a8e3a8ea2e06 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:59.296367 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b168265-fbc6-4ef6-8422-a8e3a8ea2e06 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:59.297841 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 159/309] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:05:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:05:59.298795 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b168265-fbc6-4ef6-8422-a8e3a8ea2e06 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:59.314062 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:59.377778 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3c652-3fe9-4379-a51f-9f2e96f42812 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:59.398058 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:59.423961 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a0bd4-7ae2-40d1-a1d4-2189684d75bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:59.424619 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a0bd4-7ae2-40d1-a1d4-2189684d75bf None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:59.424897 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a0bd4-7ae2-40d1-a1d4-2189684d75bf None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:59.425423 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a0bd4-7ae2-40d1-a1d4-2189684d75bf None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:59.426509 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a0bd4-7ae2-40d1-a1d4-2189684d75bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:59.426820 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a0bd4-7ae2-40d1-a1d4-2189684d75bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:59.430182 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a0bd4-7ae2-40d1-a1d4-2189684d75bf None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:59.438527 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b168265-fbc6-4ef6-8422-a8e3a8ea2e06 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:59.442405 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 151/310] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:05:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:59.443635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af5942-28f9-4713-8c91-26a329795551 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:59.443918 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af5942-28f9-4713-8c91-26a329795551 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:59.444191 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af5942-28f9-4713-8c91-26a329795551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:59.474243 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-f7af5942-28f9-4713-8c91-26a329795551 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:05:59.476333 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-f7af5942-28f9-4713-8c91-26a329795551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:05:59.478995 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1074c9-c15c-43ec-9e8d-d638cec61687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:59.479732 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1074c9-c15c-43ec-9e8d-d638cec61687 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:59.480826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1074c9-c15c-43ec-9e8d-d638cec61687 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:59.480826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1074c9-c15c-43ec-9e8d-d638cec61687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:59.481236 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1074c9-c15c-43ec-9e8d-d638cec61687 None admin] RBAC: Adding query filter params (group.id=57de530b641c4521b5aefd0bb45fb380, role.id=bbdc52113ece4f3da0ee37763b27b9e5, scope.project.id=9c71f771e47847d7a5d6f6da015ee47e) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:59.481632 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1074c9-c15c-43ec-9e8d-d638cec61687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:59.483963 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1074c9-c15c-43ec-9e8d-d638cec61687 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:59.490001 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 160/311] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Oct 20 19:05:59 2022] GET /identity/v3/role_assignments?group.id=57de530b641c4521b5aefd0bb45fb380&scope.project.id=9c71f771e47847d7a5d6f6da015ee47e&role.id=bbdc52113ece4f3da0ee37763b27b9e5 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:05:59.490883 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1074c9-c15c-43ec-9e8d-d638cec61687 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:59.574734 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 152/312] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:05:59.575697 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af5942-28f9-4713-8c91-26a329795551 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:59.585349 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:59.630937 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1074c9-c15c-43ec-9e8d-d638cec61687 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:59.723087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ad90-0be4-4618-b288-19401116ba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:59.723727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ad90-0be4-4618-b288-19401116ba34 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:59.724004 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ad90-0be4-4618-b288-19401116ba34 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:59.724293 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70ad90-0be4-4618-b288-19401116ba34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:59.745048 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70ad90-0be4-4618-b288-19401116ba34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-2a70ad90-0be4-4618-b288-19401116ba34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:05:59.751919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:05:59.753027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:05:59.753862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 161/313] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:05:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:05:59.755634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af5942-28f9-4713-8c91-26a329795551 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:59.759487 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ad90-0be4-4618-b288-19401116ba34 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:05:59.766844 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:59.803077 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1916009-be0e-405b-ae98-aad371e459e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:59.803685 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1916009-be0e-405b-ae98-aad371e459e6 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:59.803995 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1916009-be0e-405b-ae98-aad371e459e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:59.804282 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1916009-be0e-405b-ae98-aad371e459e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:59.904911 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1916009-be0e-405b-ae98-aad371e459e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:59.906375 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1916009-be0e-405b-ae98-aad371e459e6 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:59.914139 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70ad90-0be4-4618-b288-19401116ba34 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:05:59.950618 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:05:59.956856 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca8bb2-14e5-4ebd-a34c-774ed0beb7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:05:59.957817 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca8bb2-14e5-4ebd-a34c-774ed0beb7d2 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:05:59.958314 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca8bb2-14e5-4ebd-a34c-774ed0beb7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:05:59.959045 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca8bb2-14e5-4ebd-a34c-774ed0beb7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:05:59.960582 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca8bb2-14e5-4ebd-a34c-774ed0beb7d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:05:59.961201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca8bb2-14e5-4ebd-a34c-774ed0beb7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:05:59.962918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca8bb2-14e5-4ebd-a34c-774ed0beb7d2 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:05:59.974175 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 162/314] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:05:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:05:59.980517 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca8bb2-14e5-4ebd-a34c-774ed0beb7d2 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:00.037182 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 153/315] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:06:00.038033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1916009-be0e-405b-ae98-aad371e459e6 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:00.048514 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:00.125992 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca8bb2-14e5-4ebd-a34c-774ed0beb7d2 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:00.170393 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b294ec-ce65-415c-8f29-c295dda9f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:00.170945 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b294ec-ce65-415c-8f29-c295dda9f861 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:00.171224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b294ec-ce65-415c-8f29-c295dda9f861 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:00.171797 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b294ec-ce65-415c-8f29-c295dda9f861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:00.174923 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1916009-be0e-405b-ae98-aad371e459e6 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:00.220259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0e129-683d-4894-b743-67d2c9b7020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:00.221266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0e129-683d-4894-b743-67d2c9b7020a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:00.221550 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0e129-683d-4894-b743-67d2c9b7020a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:00.221823 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0e129-683d-4894-b743-67d2c9b7020a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:00.236364 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0e129-683d-4894-b743-67d2c9b7020a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-f8a0e129-683d-4894-b743-67d2c9b7020a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:00.242266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:00.243221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 154/316] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:06:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:00.244718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0e129-683d-4894-b743-67d2c9b7020a None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:00.270056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:00.280410 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b294ec-ce65-415c-8f29-c295dda9f861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:00.281820 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b294ec-ce65-415c-8f29-c295dda9f861 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:00.329588 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:00.382769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0e129-683d-4894-b743-67d2c9b7020a None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:00.427312 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 163/317] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:06:00.428098 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b294ec-ce65-415c-8f29-c295dda9f861 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:00.429896 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f426f91-3498-48d1-8dc2-0b41954e7faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:00.430530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426f91-3498-48d1-8dc2-0b41954e7faf None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:00.430808 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426f91-3498-48d1-8dc2-0b41954e7faf None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:00.431075 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f426f91-3498-48d1-8dc2-0b41954e7faf None admin] PATH_INFO: `/v3/projects/9c71f771e47847d7a5d6f6da015ee47e` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:00.432234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f426f91-3498-48d1-8dc2-0b41954e7faf None admin] RBAC: Authorizing `identity:get_project(project_id=9c71f771e47847d7a5d6f6da015ee47e)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:00.433716 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f426f91-3498-48d1-8dc2-0b41954e7faf None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:00.435561 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 155/318] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:06:00 2022] GET /identity/v3/projects/9c71f771e47847d7a5d6f6da015ee47e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:00.436311 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f426f91-3498-48d1-8dc2-0b41954e7faf None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:00.562337 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:00.567889 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f426f91-3498-48d1-8dc2-0b41954e7faf None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:00.574073 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b294ec-ce65-415c-8f29-c295dda9f861 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:00.613612 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b711c78-6fa0-4923-9ea1-44f8defaf72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:00.614241 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b711c78-6fa0-4923-9ea1-44f8defaf72f None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:00.614517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b711c78-6fa0-4923-9ea1-44f8defaf72f None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:00.616197 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b711c78-6fa0-4923-9ea1-44f8defaf72f None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:00.618602 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b711c78-6fa0-4923-9ea1-44f8defaf72f None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:00.620047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b711c78-6fa0-4923-9ea1-44f8defaf72f None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:00.621718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 156/319] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:06:00 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:00.622483 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b711c78-6fa0-4923-9ea1-44f8defaf72f None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:00.628087 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:00.633421 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728168fe-3703-47f6-9b88-bbe3a5e7d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:00.634488 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728168fe-3703-47f6-9b88-bbe3a5e7d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:00.634488 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728168fe-3703-47f6-9b88-bbe3a5e7d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:00.634674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728168fe-3703-47f6-9b88-bbe3a5e7d1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:00.635210 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728168fe-3703-47f6-9b88-bbe3a5e7d1c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:00.636160 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728168fe-3703-47f6-9b88-bbe3a5e7d1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:00.636898 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728168fe-3703-47f6-9b88-bbe3a5e7d1c7 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:00.646287 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 164/320] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:00.647291 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728168fe-3703-47f6-9b88-bbe3a5e7d1c7 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:00.751333 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b711c78-6fa0-4923-9ea1-44f8defaf72f None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:00.773554 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728168fe-3703-47f6-9b88-bbe3a5e7d1c7 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:00.794144 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8741cc0-68c1-4a7f-8680-50419f414c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:00.794778 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8741cc0-68c1-4a7f-8680-50419f414c97 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:00.795057 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8741cc0-68c1-4a7f-8680-50419f414c97 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:00.795331 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8741cc0-68c1-4a7f-8680-50419f414c97 None admin] PATH_INFO: `/v3/groups/57de530b641c4521b5aefd0bb45fb380` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:00.796481 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8741cc0-68c1-4a7f-8680-50419f414c97 None admin] RBAC: Authorizing `identity:get_group(group_id=57de530b641c4521b5aefd0bb45fb380)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:00.797986 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8741cc0-68c1-4a7f-8680-50419f414c97 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:00.799924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 157/321] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Oct 20 19:06:00 2022] GET /identity/v3/groups/57de530b641c4521b5aefd0bb45fb380 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:00.801208 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5371-5266-44bc-b60b-90310cabea32 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:00.801493 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5371-5266-44bc-b60b-90310cabea32 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:00.801766 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce5371-5266-44bc-b60b-90310cabea32 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:00.803122 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 158/322] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:00.803730 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce5371-5266-44bc-b60b-90310cabea32 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:00.813567 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd69f-0bf1-4386-9430-331f2dc8b2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:00.814451 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd69f-0bf1-4386-9430-331f2dc8b2aa None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:00.814734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd69f-0bf1-4386-9430-331f2dc8b2aa None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:00.815009 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd69f-0bf1-4386-9430-331f2dc8b2aa None admin] PATH_INFO: `/v3/groups/57de530b641c4521b5aefd0bb45fb380` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:00.816118 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fd69f-0bf1-4386-9430-331f2dc8b2aa None admin] RBAC: Authorizing `identity:get_group(group_id=57de530b641c4521b5aefd0bb45fb380)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:00.817592 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fd69f-0bf1-4386-9430-331f2dc8b2aa None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:00.819154 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 165/323] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Oct 20 19:06:00 2022] GET /identity/v3/groups/57de530b641c4521b5aefd0bb45fb380 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:00.820783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd69f-0bf1-4386-9430-331f2dc8b2aa None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:00.845762 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:00.874756 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:00.907407 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce5371-5266-44bc-b60b-90310cabea32 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:00.922116 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd69f-0bf1-4386-9430-331f2dc8b2aa None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:00.940937 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0bf2-4227-4508-a22e-05e265465ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:00.941586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0bf2-4227-4508-a22e-05e265465ad7 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:00.941821 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0bf2-4227-4508-a22e-05e265465ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:00.942087 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0bf2-4227-4508-a22e-05e265465ad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:00.955616 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38e702-4ca5-4518-82db-a5ac111ff67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:00.956211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38e702-4ca5-4518-82db-a5ac111ff67b None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:00.956518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38e702-4ca5-4518-82db-a5ac111ff67b None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:00.956785 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38e702-4ca5-4518-82db-a5ac111ff67b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:00.957504 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38e702-4ca5-4518-82db-a5ac111ff67b None admin] RBAC: Adding query filter params (group.id=57de530b641c4521b5aefd0bb45fb380, role.id=e399cea584ee4afd9e0dbad4959cd49c, scope.project.id=9c71f771e47847d7a5d6f6da015ee47e) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:00.957812 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38e702-4ca5-4518-82db-a5ac111ff67b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:00.959232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38e702-4ca5-4518-82db-a5ac111ff67b None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:00.965173 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 166/324] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Oct 20 19:06:00 2022] GET /identity/v3/role_assignments?group.id=57de530b641c4521b5aefd0bb45fb380&scope.project.id=9c71f771e47847d7a5d6f6da015ee47e&role.id=e399cea584ee4afd9e0dbad4959cd49c => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:00.966292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c72c2-2fdd-4a12-9da0-6b60ec7c55ec None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:00.966571 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c72c2-2fdd-4a12-9da0-6b60ec7c55ec None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:00.966841 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c72c2-2fdd-4a12-9da0-6b60ec7c55ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:00.986202 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-392c72c2-2fdd-4a12-9da0-6b60ec7c55ec None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:00.987434 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-392c72c2-2fdd-4a12-9da0-6b60ec7c55ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:01.019785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f0bf2-4227-4508-a22e-05e265465ad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:01.021409 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f0bf2-4227-4508-a22e-05e265465ad7 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:01.067645 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 167/325] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:01.068541 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c72c2-2fdd-4a12-9da0-6b60ec7c55ec None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:01.093298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:01.110792 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:01.149147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 159/326] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:06:01.154430 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0bf2-4227-4508-a22e-05e265465ad7 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:01.222625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c72c2-2fdd-4a12-9da0-6b60ec7c55ec None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:01.267455 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d52d6a-b090-48a0-a76d-16cf5f58009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:01.268869 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d52d6a-b090-48a0-a76d-16cf5f58009f None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:01.269293 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d52d6a-b090-48a0-a76d-16cf5f58009f None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:01.269987 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d52d6a-b090-48a0-a76d-16cf5f58009f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:01.271050 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d52d6a-b090-48a0-a76d-16cf5f58009f None admin] RBAC: Adding query filter params (group.id=57de530b641c4521b5aefd0bb45fb380, role.id=bbdc52113ece4f3da0ee37763b27b9e5, scope.project.id=4c3e52ada92f4695b6b642ba8afea967) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:01.272013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d52d6a-b090-48a0-a76d-16cf5f58009f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:01.273775 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d52d6a-b090-48a0-a76d-16cf5f58009f None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:01.280748 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 168/327] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Oct 20 19:06:01 2022] GET /identity/v3/role_assignments?group.id=57de530b641c4521b5aefd0bb45fb380&scope.project.id=4c3e52ada92f4695b6b642ba8afea967&role.id=bbdc52113ece4f3da0ee37763b27b9e5 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:01.282298 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0bf2-4227-4508-a22e-05e265465ad7 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:01.324347 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8bac-d701-43da-b221-0d4326068367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:01.325003 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8bac-d701-43da-b221-0d4326068367 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:01.325282 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8bac-d701-43da-b221-0d4326068367 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:01.325553 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e8bac-d701-43da-b221-0d4326068367 None admin] PATH_INFO: `/v3/projects/4c3e52ada92f4695b6b642ba8afea967` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:01.326934 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e8bac-d701-43da-b221-0d4326068367 None admin] RBAC: Authorizing `identity:get_project(project_id=4c3e52ada92f4695b6b642ba8afea967)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:01.328453 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e8bac-d701-43da-b221-0d4326068367 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:01.330578 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 160/328] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:06:01 2022] GET /identity/v3/projects/4c3e52ada92f4695b6b642ba8afea967 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:01.335958 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d52d6a-b090-48a0-a76d-16cf5f58009f None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:01.406429 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8bac-d701-43da-b221-0d4326068367 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:01.439076 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:01.458629 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:01.463418 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d52d6a-b090-48a0-a76d-16cf5f58009f None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:01.512785 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47410607-e4e2-4def-a46a-9daa7bab9884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:01.513352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47410607-e4e2-4def-a46a-9daa7bab9884 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:01.513655 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47410607-e4e2-4def-a46a-9daa7bab9884 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:01.513935 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47410607-e4e2-4def-a46a-9daa7bab9884 None admin] PATH_INFO: `/v3/groups/57de530b641c4521b5aefd0bb45fb380` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:01.516997 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47410607-e4e2-4def-a46a-9daa7bab9884 None admin] RBAC: Authorizing `identity:get_group(group_id=57de530b641c4521b5aefd0bb45fb380)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:01.518445 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47410607-e4e2-4def-a46a-9daa7bab9884 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:01.520531 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 169/329] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Oct 20 19:06:01 2022] GET /identity/v3/groups/57de530b641c4521b5aefd0bb45fb380 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:01.528297 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47410607-e4e2-4def-a46a-9daa7bab9884 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:01.553777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e8bac-d701-43da-b221-0d4326068367 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:01.594329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105abaa6-89ea-40c4-ba8a-e2d019ce53d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:01.594861 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abaa6-89ea-40c4-ba8a-e2d019ce53d6 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:01.595134 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abaa6-89ea-40c4-ba8a-e2d019ce53d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:01.595402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105abaa6-89ea-40c4-ba8a-e2d019ce53d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:01.612425 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105abaa6-89ea-40c4-ba8a-e2d019ce53d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-105abaa6-89ea-40c4-ba8a-e2d019ce53d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:01.617600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:01.618706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:01.619696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 161/330] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 19:06:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:06:01.624733 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105abaa6-89ea-40c4-ba8a-e2d019ce53d6 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:01.651888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47410607-e4e2-4def-a46a-9daa7bab9884 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:01.689772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e795d2-9dcb-48fa-9450-8dbe74a2ddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:01.689978 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e795d2-9dcb-48fa-9450-8dbe74a2ddbd None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:01.690929 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e795d2-9dcb-48fa-9450-8dbe74a2ddbd None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:01.690929 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e795d2-9dcb-48fa-9450-8dbe74a2ddbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:01.693060 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e795d2-9dcb-48fa-9450-8dbe74a2ddbd None admin] RBAC: Adding query filter params (group.id=57de530b641c4521b5aefd0bb45fb380, role.id=e399cea584ee4afd9e0dbad4959cd49c, scope.project.id=4c3e52ada92f4695b6b642ba8afea967) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:01.693060 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e795d2-9dcb-48fa-9450-8dbe74a2ddbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:01.693733 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e795d2-9dcb-48fa-9450-8dbe74a2ddbd None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:01.702156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 170/331] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Oct 20 19:06:01 2022] GET /identity/v3/role_assignments?group.id=57de530b641c4521b5aefd0bb45fb380&scope.project.id=4c3e52ada92f4695b6b642ba8afea967&role.id=e399cea584ee4afd9e0dbad4959cd49c => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:01.743429 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:01.747383 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105abaa6-89ea-40c4-ba8a-e2d019ce53d6 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:01.785786 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27f3e2-9d24-431b-89e3-f6201ce163bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:01.786307 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f3e2-9d24-431b-89e3-f6201ce163bd None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:01.786585 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f3e2-9d24-431b-89e3-f6201ce163bd None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:01.786852 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f3e2-9d24-431b-89e3-f6201ce163bd None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:01.787513 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27f3e2-9d24-431b-89e3-f6201ce163bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:01.787813 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27f3e2-9d24-431b-89e3-f6201ce163bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:01.789555 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27f3e2-9d24-431b-89e3-f6201ce163bd None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:01.798842 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 162/332] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:06:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:01.804953 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e795d2-9dcb-48fa-9450-8dbe74a2ddbd None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:01.822272 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:01.910528 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e795d2-9dcb-48fa-9450-8dbe74a2ddbd None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:01.947716 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3249d9-b18b-47d5-a489-6085bbb1df06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:01.948344 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3249d9-b18b-47d5-a489-6085bbb1df06 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:01.948629 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3249d9-b18b-47d5-a489-6085bbb1df06 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:01.948901 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3249d9-b18b-47d5-a489-6085bbb1df06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:02.014958 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3249d9-b18b-47d5-a489-6085bbb1df06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:02.016416 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3249d9-b18b-47d5-a489-6085bbb1df06 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:02.031276 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:02.115858 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 171/333] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:06:02.122311 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27f3e2-9d24-431b-89e3-f6201ce163bd None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:02.217922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27f3e2-9d24-431b-89e3-f6201ce163bd None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:02.250057 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a498d75-cd0a-4e4b-8a4e-bd2c1e14a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:02.250662 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498d75-cd0a-4e4b-8a4e-bd2c1e14a249 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:02.250935 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498d75-cd0a-4e4b-8a4e-bd2c1e14a249 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:02.251202 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498d75-cd0a-4e4b-8a4e-bd2c1e14a249 None admin] PATH_INFO: `/v3/projects/fb75e3ae7a47470dbe383104be65755f` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:02.252319 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a498d75-cd0a-4e4b-8a4e-bd2c1e14a249 None admin] RBAC: Authorizing `identity:get_project(project_id=fb75e3ae7a47470dbe383104be65755f)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:02.253736 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a498d75-cd0a-4e4b-8a4e-bd2c1e14a249 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:02.255329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 163/334] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Oct 20 19:06:02 2022] GET /identity/v3/projects/fb75e3ae7a47470dbe383104be65755f => generated 344 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:02.261305 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3249d9-b18b-47d5-a489-6085bbb1df06 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:02.357307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3249d9-b18b-47d5-a489-6085bbb1df06 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:02.372130 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:02.392617 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2735c-f2b4-4238-b62b-076e42d6d2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:02.393240 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2735c-f2b4-4238-b62b-076e42d6d2db None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:02.393520 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2735c-f2b4-4238-b62b-076e42d6d2db None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:02.393790 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2735c-f2b4-4238-b62b-076e42d6d2db None admin] PATH_INFO: `/v3/groups/99a1fcf2e4084661b5a972347548d3ed` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:02.394874 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2735c-f2b4-4238-b62b-076e42d6d2db None admin] RBAC: Authorizing `identity:get_group(group_id=99a1fcf2e4084661b5a972347548d3ed)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:02.396315 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2735c-f2b4-4238-b62b-076e42d6d2db None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:02.398091 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 172/335] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Oct 20 19:06:02 2022] GET /identity/v3/groups/99a1fcf2e4084661b5a972347548d3ed => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:02.403863 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a498d75-cd0a-4e4b-8a4e-bd2c1e14a249 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:02.433198 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:02.502492 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a498d75-cd0a-4e4b-8a4e-bd2c1e14a249 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:02.533863 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ec283-bc20-43c9-9ced-2d0bd5645124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:02.534445 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec283-bc20-43c9-9ced-2d0bd5645124 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:02.534721 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec283-bc20-43c9-9ced-2d0bd5645124 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:02.534990 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec283-bc20-43c9-9ced-2d0bd5645124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:02.535701 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec283-bc20-43c9-9ced-2d0bd5645124 None admin] RBAC: Adding query filter params (group.id=99a1fcf2e4084661b5a972347548d3ed, role.id=fde247f30afe4b81958b67c776cabec0, scope.project.id=fb75e3ae7a47470dbe383104be65755f) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:02.536005 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec283-bc20-43c9-9ced-2d0bd5645124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:02.537459 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec283-bc20-43c9-9ced-2d0bd5645124 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:02.543909 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 164/336] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Oct 20 19:06:02 2022] GET /identity/v3/role_assignments?group.id=99a1fcf2e4084661b5a972347548d3ed&scope.project.id=fb75e3ae7a47470dbe383104be65755f&role.id=fde247f30afe4b81958b67c776cabec0 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:05.256071 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf531c8-1f04-4471-aa6a-81152b474d3e None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:05.256673 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf531c8-1f04-4471-aa6a-81152b474d3e None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:05.256989 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf531c8-1f04-4471-aa6a-81152b474d3e None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:05.258928 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 173/337] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:05.264180 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9de6d-3273-4a00-88d4-b55667b0cd14 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:05.264942 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9de6d-3273-4a00-88d4-b55667b0cd14 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:05.265362 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9de6d-3273-4a00-88d4-b55667b0cd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:05.283962 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-13d9de6d-3273-4a00-88d4-b55667b0cd14 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:05.285427 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-13d9de6d-3273-4a00-88d4-b55667b0cd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:05.360393 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 165/338] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 19:06:05.406100 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cd5d4-4eb8-421f-aa99-8f015a048450 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:05.406378 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cd5d4-4eb8-421f-aa99-8f015a048450 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:05.406651 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cd5d4-4eb8-421f-aa99-8f015a048450 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:05.407970 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 174/339] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:05.413619 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315194-24f3-443c-bb74-ab20dce32414 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:05.413909 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315194-24f3-443c-bb74-ab20dce32414 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:05.414180 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315194-24f3-443c-bb74-ab20dce32414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:05.432552 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-c3315194-24f3-443c-bb74-ab20dce32414 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:05.433713 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-c3315194-24f3-443c-bb74-ab20dce32414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:05.450809 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:05.502338 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 166/340] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:05.573749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d3236-7ff3-4556-a4c1-b4727aa85dbf None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:05.573927 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d3236-7ff3-4556-a4c1-b4727aa85dbf None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:05.574198 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d3236-7ff3-4556-a4c1-b4727aa85dbf None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:05.575812 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 175/341] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:05.581259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2203-b918-4afc-8195-f2e50e7c8596 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:05.581542 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2203-b918-4afc-8195-f2e50e7c8596 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:05.581811 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec2203-b918-4afc-8195-f2e50e7c8596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:05.600014 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-42ec2203-b918-4afc-8195-f2e50e7c8596 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:05.601732 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-42ec2203-b918-4afc-8195-f2e50e7c8596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:05.675740 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 167/342] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:05.709113 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d3236-7ff3-4556-a4c1-b4727aa85dbf None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:05.818679 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d3236-7ff3-4556-a4c1-b4727aa85dbf None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:05.842321 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec2203-b918-4afc-8195-f2e50e7c8596 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:05.853563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad443e-cceb-4671-b01e-e7843e75f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:05.854186 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad443e-cceb-4671-b01e-e7843e75f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:05.854455 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad443e-cceb-4671-b01e-e7843e75f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:05.854716 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad443e-cceb-4671-b01e-e7843e75f4d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:05.865936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad443e-cceb-4671-b01e-e7843e75f4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:05.867698 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad443e-cceb-4671-b01e-e7843e75f4d8 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-efad443e-cceb-4671-b01e-e7843e75f4d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:05.884443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:05.885420 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:05.886266 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:05.886266 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:05.886266 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:05.886266 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 176/343] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:05.891281 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad443e-cceb-4671-b01e-e7843e75f4d8 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:05.927066 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:05.935358 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:05.955362 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec2203-b918-4afc-8195-f2e50e7c8596 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:05.991908 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f787cdc-4708-473a-b40d-d65f7253bf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:05.993016 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f787cdc-4708-473a-b40d-d65f7253bf8f None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:05.993511 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f787cdc-4708-473a-b40d-d65f7253bf8f None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:05.993971 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f787cdc-4708-473a-b40d-d65f7253bf8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:05.998956 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad443e-cceb-4671-b01e-e7843e75f4d8 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:06.005387 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f787cdc-4708-473a-b40d-d65f7253bf8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:06.007737 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f787cdc-4708-473a-b40d-d65f7253bf8f None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-7f787cdc-4708-473a-b40d-d65f7253bf8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:06.025186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:06.026116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:06.027784 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:06.027784 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:06.027784 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:06.027784 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 168/344] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:06:06.031712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f787cdc-4708-473a-b40d-d65f7253bf8f None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:06.035982 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca1320-8226-4adf-b3e3-2ef1f63c8950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:06.036606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca1320-8226-4adf-b3e3-2ef1f63c8950 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:06.036880 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca1320-8226-4adf-b3e3-2ef1f63c8950 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:06.037144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca1320-8226-4adf-b3e3-2ef1f63c8950 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:06.037786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca1320-8226-4adf-b3e3-2ef1f63c8950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:06.038609 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca1320-8226-4adf-b3e3-2ef1f63c8950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:06.039949 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca1320-8226-4adf-b3e3-2ef1f63c8950 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:06.052490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 177/345] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:06.053294 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca1320-8226-4adf-b3e3-2ef1f63c8950 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:06.132713 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f787cdc-4708-473a-b40d-d65f7253bf8f None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:06.144064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:06.151312 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca1320-8226-4adf-b3e3-2ef1f63c8950 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:06.165013 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e43ac3-a7ca-4d12-a436-87b05e2a1a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:06.165625 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e43ac3-a7ca-4d12-a436-87b05e2a1a0a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:06.165899 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e43ac3-a7ca-4d12-a436-87b05e2a1a0a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:06.166162 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e43ac3-a7ca-4d12-a436-87b05e2a1a0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:06.168242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:06.178071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e43ac3-a7ca-4d12-a436-87b05e2a1a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:06.180049 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e43ac3-a7ca-4d12-a436-87b05e2a1a0a None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:06.185595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64b945-df0d-49e5-92b1-9db1acb0078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:06.186229 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64b945-df0d-49e5-92b1-9db1acb0078a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:06.186494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64b945-df0d-49e5-92b1-9db1acb0078a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:06.186764 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64b945-df0d-49e5-92b1-9db1acb0078a None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:06.187411 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64b945-df0d-49e5-92b1-9db1acb0078a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:06.187715 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64b945-df0d-49e5-92b1-9db1acb0078a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:06.189084 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64b945-df0d-49e5-92b1-9db1acb0078a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-d4e43ac3-a7ca-4d12-a436-87b05e2a1a0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:06.193763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:06.194839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:06.195733 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:06.195733 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:06.195733 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:06.195733 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 169/346] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:06.196299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6bdf8-36b6-4f23-b3a9-4dad9dc99be4 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:06.196570 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6bdf8-36b6-4f23-b3a9-4dad9dc99be4 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:06.196839 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6bdf8-36b6-4f23-b3a9-4dad9dc99be4 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:06.198059 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 170/347] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:06.198716 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6bdf8-36b6-4f23-b3a9-4dad9dc99be4 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:06.203802 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 178/348] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:06.204577 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64b945-df0d-49e5-92b1-9db1acb0078a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:06.299566 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64b945-df0d-49e5-92b1-9db1acb0078a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:06.300182 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6bdf8-36b6-4f23-b3a9-4dad9dc99be4 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:06.333132 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc665c0-d4de-466f-8f22-c8b302d4963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:06.333400 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b58570-ee9f-48d0-b1e6-c059d9927bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:06.333729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b58570-ee9f-48d0-b1e6-c059d9927bc0 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:06.333830 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc665c0-d4de-466f-8f22-c8b302d4963c None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:06.334007 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc665c0-d4de-466f-8f22-c8b302d4963c None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:06.334101 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b58570-ee9f-48d0-b1e6-c059d9927bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:06.334273 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b58570-ee9f-48d0-b1e6-c059d9927bc0 None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:06.334357 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc665c0-d4de-466f-8f22-c8b302d4963c None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:06.334945 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc665c0-d4de-466f-8f22-c8b302d4963c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:06.335242 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc665c0-d4de-466f-8f22-c8b302d4963c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:06.335338 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b58570-ee9f-48d0-b1e6-c059d9927bc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:06.336645 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc665c0-d4de-466f-8f22-c8b302d4963c None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:06.336789 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b58570-ee9f-48d0-b1e6-c059d9927bc0 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:06.348794 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 179/349] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:06.348794 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf5eab-ebeb-4833-b485-13309cdb16d9 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:06.348794 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf5eab-ebeb-4833-b485-13309cdb16d9 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:06.348794 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf5eab-ebeb-4833-b485-13309cdb16d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:06.372299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 171/350] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:06:06 2022] POST /identity/v3/users => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:06.372299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b58570-ee9f-48d0-b1e6-c059d9927bc0 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:06.372603 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-b5bf5eab-ebeb-4833-b485-13309cdb16d9 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:06.373028 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-b5bf5eab-ebeb-4833-b485-13309cdb16d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:06.384418 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:06.411882 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:06.454638 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 180/351] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:06.455573 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf5eab-ebeb-4833-b485-13309cdb16d9 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:06.497089 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b58570-ee9f-48d0-b1e6-c059d9927bc0 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:06.549996 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75960ad4-9cd5-40c1-9b1c-f1bface4446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:06.550649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75960ad4-9cd5-40c1-9b1c-f1bface4446b None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:06.550924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75960ad4-9cd5-40c1-9b1c-f1bface4446b None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:06.551185 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75960ad4-9cd5-40c1-9b1c-f1bface4446b None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:06.551896 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75960ad4-9cd5-40c1-9b1c-f1bface4446b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:06.554681 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75960ad4-9cd5-40c1-9b1c-f1bface4446b None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:06.585759 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 172/352] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:06:06 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:06.592316 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf5eab-ebeb-4833-b485-13309cdb16d9 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:06.637167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d73252-0385-4497-9598-e389ba00d7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:06.637701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d73252-0385-4497-9598-e389ba00d7fc None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:06.637973 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d73252-0385-4497-9598-e389ba00d7fc None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:06.638238 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d73252-0385-4497-9598-e389ba00d7fc None admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:06.638903 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d73252-0385-4497-9598-e389ba00d7fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:06.640365 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d73252-0385-4497-9598-e389ba00d7fc None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:06.662343 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:06.668718 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 181/353] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:06:06 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:06.814758 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75960ad4-9cd5-40c1-9b1c-f1bface4446b None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:06.930690 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:06.936141 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75960ad4-9cd5-40c1-9b1c-f1bface4446b None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:06.976057 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a707f0-989a-4eac-88a4-04e57634e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:06.976744 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a707f0-989a-4eac-88a4-04e57634e590 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:06.977015 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a707f0-989a-4eac-88a4-04e57634e590 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:06.977280 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a707f0-989a-4eac-88a4-04e57634e590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:06.988060 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a707f0-989a-4eac-88a4-04e57634e590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:06.989541 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a707f0-989a-4eac-88a4-04e57634e590 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-f8a707f0-989a-4eac-88a4-04e57634e590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:07.004374 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:07.005323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:07.007160 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:07.007160 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:07.007160 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:07.007160 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 173/354] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:07.012093 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d73252-0385-4497-9598-e389ba00d7fc None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:07.118963 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d73252-0385-4497-9598-e389ba00d7fc None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:07.154133 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500ddd-2d6c-4843-a39c-73214fcc8845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:07.154743 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500ddd-2d6c-4843-a39c-73214fcc8845 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:07.155017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500ddd-2d6c-4843-a39c-73214fcc8845 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:07.155287 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500ddd-2d6c-4843-a39c-73214fcc8845 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:07.155926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9500ddd-2d6c-4843-a39c-73214fcc8845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:07.156226 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9500ddd-2d6c-4843-a39c-73214fcc8845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:07.157605 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9500ddd-2d6c-4843-a39c-73214fcc8845 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:07.170598 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 182/355] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:07.175991 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a707f0-989a-4eac-88a4-04e57634e590 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:07.283737 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a707f0-989a-4eac-88a4-04e57634e590 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:07.320585 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce3628-9906-4461-a22e-be1d971990af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:07.321208 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3628-9906-4461-a22e-be1d971990af None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:07.321503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3628-9906-4461-a22e-be1d971990af None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:07.321873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce3628-9906-4461-a22e-be1d971990af None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:07.322658 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce3628-9906-4461-a22e-be1d971990af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:07.324060 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce3628-9906-4461-a22e-be1d971990af None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:07.347858 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 174/356] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:06:07 2022] POST /identity/v3/users => generated 249 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:09.007114 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24dcd4-9aa2-4f37-a5ab-1df42024f23f None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.007712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24dcd4-9aa2-4f37-a5ab-1df42024f23f None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.007712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24dcd4-9aa2-4f37-a5ab-1df42024f23f None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.009176 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 183/357] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:09.014739 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce2afe-12c3-4a74-9ff0-a05798b3c43d None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.015155 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce2afe-12c3-4a74-9ff0-a05798b3c43d None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.015325 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce2afe-12c3-4a74-9ff0-a05798b3c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.028827 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:09.034805 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-edce2afe-12c3-4a74-9ff0-a05798b3c43d None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:09.036006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-edce2afe-12c3-4a74-9ff0-a05798b3c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:09.096735 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b7f3-4712-43e0-873f-7fa89bba485b None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.097085 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b7f3-4712-43e0-873f-7fa89bba485b None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.097271 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0b7f3-4712-43e0-873f-7fa89bba485b None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.098827 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 184/358] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:09.104386 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140711-f55c-40f7-94ae-3b2a246e2a54 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.104669 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140711-f55c-40f7-94ae-3b2a246e2a54 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.104934 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140711-f55c-40f7-94ae-3b2a246e2a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.109093 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 175/359] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:09.123330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-0c140711-f55c-40f7-94ae-3b2a246e2a54 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:09.124532 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-0c140711-f55c-40f7-94ae-3b2a246e2a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:09.182232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:09.194591 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 185/360] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:09.250774 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da58e6-d180-4cef-936d-492b8557b75f None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.251090 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da58e6-d180-4cef-936d-492b8557b75f None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.251325 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da58e6-d180-4cef-936d-492b8557b75f None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.252968 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 176/361] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:09.261938 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eb319-bf7a-4377-886c-ff8a945a234d None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.261938 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eb319-bf7a-4377-886c-ff8a945a234d None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.261938 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4eb319-bf7a-4377-886c-ff8a945a234d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.277978 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-4c4eb319-bf7a-4377-886c-ff8a945a234d None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:09.279344 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-4c4eb319-bf7a-4377-886c-ff8a945a234d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:09.352371 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 186/362] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:09.458954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da58e6-d180-4cef-936d-492b8557b75f None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:09.518621 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4eb319-bf7a-4377-886c-ff8a945a234d None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:09.575409 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da58e6-d180-4cef-936d-492b8557b75f None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:09.611577 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbed36a-b491-480a-9421-35473db54c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:09.612227 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed36a-b491-480a-9421-35473db54c3a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.612549 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed36a-b491-480a-9421-35473db54c3a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.612825 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed36a-b491-480a-9421-35473db54c3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.615492 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:09.626104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbed36a-b491-480a-9421-35473db54c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-5dbed36a-b491-480a-9421-35473db54c3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:09.631023 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:09.632033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:09.632865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:09.636984 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 177/363] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:06:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:09.638284 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbed36a-b491-480a-9421-35473db54c3a None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:09.650703 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4eb319-bf7a-4377-886c-ff8a945a234d None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:09.678872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:09.700065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65604d2-e909-4c2b-8751-8d64806803b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:09.700923 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65604d2-e909-4c2b-8751-8d64806803b2 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.701348 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65604d2-e909-4c2b-8751-8d64806803b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.701622 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65604d2-e909-4c2b-8751-8d64806803b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.713389 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65604d2-e909-4c2b-8751-8d64806803b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-f65604d2-e909-4c2b-8751-8d64806803b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:09.718564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:09.719457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:09.720263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 187/364] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:06:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:06:09.720952 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65604d2-e909-4c2b-8751-8d64806803b2 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:09.748762 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbed36a-b491-480a-9421-35473db54c3a None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:09.787620 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52b31d-f426-4105-826e-a117a01009cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:09.789141 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52b31d-f426-4105-826e-a117a01009cf None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.789429 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52b31d-f426-4105-826e-a117a01009cf None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.789704 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52b31d-f426-4105-826e-a117a01009cf None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.790369 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52b31d-f426-4105-826e-a117a01009cf None admin] RBAC: Adding query filter params (name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:09.790673 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52b31d-f426-4105-826e-a117a01009cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:09.792363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52b31d-f426-4105-826e-a117a01009cf None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:09.800903 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 178/365] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 19:06:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:09.801611 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52b31d-f426-4105-826e-a117a01009cf None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:09.836252 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65604d2-e909-4c2b-8751-8d64806803b2 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:09.865322 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:09.874142 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf1b02-ceef-4955-8770-f324a9543320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:09.874792 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf1b02-ceef-4955-8770-f324a9543320 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.875051 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf1b02-ceef-4955-8770-f324a9543320 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.875320 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf1b02-ceef-4955-8770-f324a9543320 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.888490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf1b02-ceef-4955-8770-f324a9543320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-7bdf1b02-ceef-4955-8770-f324a9543320 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:09.893246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:09.894104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 188/366] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:06:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:09.895244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf1b02-ceef-4955-8770-f324a9543320 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:09.911422 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52b31d-f426-4105-826e-a117a01009cf None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:09.937608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:09.945068 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a093d2-5e1f-4f35-9453-31d356a80657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:09.945700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a093d2-5e1f-4f35-9453-31d356a80657 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.945974 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a093d2-5e1f-4f35-9453-31d356a80657 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.946238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a093d2-5e1f-4f35-9453-31d356a80657 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.946890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a093d2-5e1f-4f35-9453-31d356a80657 None admin] RBAC: Adding query filter params (name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:09.947190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a093d2-5e1f-4f35-9453-31d356a80657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:09.948570 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a093d2-5e1f-4f35-9453-31d356a80657 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:09.956214 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 179/367] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 19:06:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:09.957348 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14925c7-c291-49d3-b032-ea9ad7c0d025 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:09.957632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14925c7-c291-49d3-b032-ea9ad7c0d025 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:09.957900 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14925c7-c291-49d3-b032-ea9ad7c0d025 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:09.959074 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 180/368] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:09.960619 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14925c7-c291-49d3-b032-ea9ad7c0d025 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.000968 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf1b02-ceef-4955-8770-f324a9543320 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.034219 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606e08b-2b52-4928-8f22-c7532f6f5d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.034818 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606e08b-2b52-4928-8f22-c7532f6f5d02 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.035095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606e08b-2b52-4928-8f22-c7532f6f5d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.035359 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606e08b-2b52-4928-8f22-c7532f6f5d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.048007 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606e08b-2b52-4928-8f22-c7532f6f5d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:10.049440 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606e08b-2b52-4928-8f22-c7532f6f5d02 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:10.059361 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14925c7-c291-49d3-b032-ea9ad7c0d025 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-4606e08b-2b52-4928-8f22-c7532f6f5d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:10.063876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:10.064974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:10.065977 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:10.065977 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:10.065977 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:10.065977 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 189/369] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:10.067301 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606e08b-2b52-4928-8f22-c7532f6f5d02 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.080426 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:10.097480 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d3c88-58e8-4665-8887-e71e06089461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.098079 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d3c88-58e8-4665-8887-e71e06089461 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.098353 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d3c88-58e8-4665-8887-e71e06089461 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.098625 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d3c88-58e8-4665-8887-e71e06089461 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.099279 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d3c88-58e8-4665-8887-e71e06089461 None admin] RBAC: Adding query filter params (name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:10.099579 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d3c88-58e8-4665-8887-e71e06089461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:10.101319 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d3c88-58e8-4665-8887-e71e06089461 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:10.109286 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 181/370] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 19:06:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:10.110516 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e31da-8e17-4fe7-95fe-86abed097393 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.110793 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e31da-8e17-4fe7-95fe-86abed097393 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.111059 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e31da-8e17-4fe7-95fe-86abed097393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.128170 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-997e31da-8e17-4fe7-95fe-86abed097393 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:10.129355 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-997e31da-8e17-4fe7-95fe-86abed097393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:10.161250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:10.170897 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606e08b-2b52-4928-8f22-c7532f6f5d02 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.193893 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 182/371] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:10.194068 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e31da-8e17-4fe7-95fe-86abed097393 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.204255 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b792ab-281c-4992-a523-3845f00b1158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.204964 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b792ab-281c-4992-a523-3845f00b1158 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.205272 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b792ab-281c-4992-a523-3845f00b1158 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.205544 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b792ab-281c-4992-a523-3845f00b1158 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.217186 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b792ab-281c-4992-a523-3845f00b1158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:10.218620 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b792ab-281c-4992-a523-3845f00b1158 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-73b792ab-281c-4992-a523-3845f00b1158 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:10.233682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:10.234572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:10.235407 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:10.235407 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:10.235407 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:10.235407 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 190/372] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:10.235616 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b792ab-281c-4992-a523-3845f00b1158 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.308238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e31da-8e17-4fe7-95fe-86abed097393 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.322093 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:10.342999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b792ab-281c-4992-a523-3845f00b1158 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.346524 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8df11-0991-47a9-ba11-d13ec489870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.347131 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8df11-0991-47a9-ba11-d13ec489870f None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.347409 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8df11-0991-47a9-ba11-d13ec489870f None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.347679 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8df11-0991-47a9-ba11-d13ec489870f None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.348356 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8df11-0991-47a9-ba11-d13ec489870f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:10.348663 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8df11-0991-47a9-ba11-d13ec489870f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:10.350359 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8df11-0991-47a9-ba11-d13ec489870f None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:10.373714 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 183/373] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:10.374573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8df11-0991-47a9-ba11-d13ec489870f None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.378016 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef05d4-a534-4b81-a7ea-7dd844894cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.378639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef05d4-a534-4b81-a7ea-7dd844894cfa None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.378911 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef05d4-a534-4b81-a7ea-7dd844894cfa None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.379175 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef05d4-a534-4b81-a7ea-7dd844894cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.390573 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef05d4-a534-4b81-a7ea-7dd844894cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:10.391990 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef05d4-a534-4b81-a7ea-7dd844894cfa None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:10.394794 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-2eef05d4-a534-4b81-a7ea-7dd844894cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:10.407095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:10.408003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:10.408888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:10.408888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:10.408888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:10.408888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 191/374] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:10.409104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef05d4-a534-4b81-a7ea-7dd844894cfa None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.492529 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8df11-0991-47a9-ba11-d13ec489870f None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.507873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef05d4-a534-4b81-a7ea-7dd844894cfa None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.532842 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14c1aa-88fe-4c46-8969-8a454bf03d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.533472 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c1aa-88fe-4c46-8969-8a454bf03d91 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.533749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c1aa-88fe-4c46-8969-8a454bf03d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.534020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14c1aa-88fe-4c46-8969-8a454bf03d91 None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.534654 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14c1aa-88fe-4c46-8969-8a454bf03d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:10.534955 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14c1aa-88fe-4c46-8969-8a454bf03d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:10.536351 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14c1aa-88fe-4c46-8969-8a454bf03d91 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:10.544141 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453abdd-ee0b-4c65-af9d-0bccbf962fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.544801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453abdd-ee0b-4c65-af9d-0bccbf962fbf None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.545075 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453abdd-ee0b-4c65-af9d-0bccbf962fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.545350 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453abdd-ee0b-4c65-af9d-0bccbf962fbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.548365 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 184/375] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:10.552733 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453abdd-ee0b-4c65-af9d-0bccbf962fbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:10.553131 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14c1aa-88fe-4c46-8969-8a454bf03d91 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.554198 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453abdd-ee0b-4c65-af9d-0bccbf962fbf None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-6453abdd-ee0b-4c65-af9d-0bccbf962fbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:06:10.566518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:10.567478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 192/376] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Oct 20 19:06:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:10.568425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453abdd-ee0b-4c65-af9d-0bccbf962fbf None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.583786 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:10.624826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:10.652837 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14c1aa-88fe-4c46-8969-8a454bf03d91 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.667975 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453abdd-ee0b-4c65-af9d-0bccbf962fbf None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.687848 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9aa6d-28cd-4762-9693-d7b70d5f4707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.688479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9aa6d-28cd-4762-9693-d7b70d5f4707 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.688751 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9aa6d-28cd-4762-9693-d7b70d5f4707 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.689013 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9aa6d-28cd-4762-9693-d7b70d5f4707 None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.689772 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9aa6d-28cd-4762-9693-d7b70d5f4707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:10.689972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9aa6d-28cd-4762-9693-d7b70d5f4707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:10.691316 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9aa6d-28cd-4762-9693-d7b70d5f4707 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:10.703275 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 185/377] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:10.704062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9aa6d-28cd-4762-9693-d7b70d5f4707 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.708993 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c04f4-1b46-41a2-9cdc-ceae368a3f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.709764 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c04f4-1b46-41a2-9cdc-ceae368a3f87 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.710106 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c04f4-1b46-41a2-9cdc-ceae368a3f87 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.710455 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c04f4-1b46-41a2-9cdc-ceae368a3f87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.720930 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c04f4-1b46-41a2-9cdc-ceae368a3f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-d39c04f4-1b46-41a2-9cdc-ceae368a3f87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:10.726849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:10.727909 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 193/378] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:06:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:10.728926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c04f4-1b46-41a2-9cdc-ceae368a3f87 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.797192 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:10.807238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9aa6d-28cd-4762-9693-d7b70d5f4707 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.832181 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c04f4-1b46-41a2-9cdc-ceae368a3f87 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.839927 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e087f-d8bc-4fa0-839d-6f68acdb3342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.840576 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e087f-d8bc-4fa0-839d-6f68acdb3342 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.840849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e087f-d8bc-4fa0-839d-6f68acdb3342 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.841114 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e087f-d8bc-4fa0-839d-6f68acdb3342 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.847674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:10.847914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e087f-d8bc-4fa0-839d-6f68acdb3342 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:10.849334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e087f-d8bc-4fa0-839d-6f68acdb3342 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-815e087f-d8bc-4fa0-839d-6f68acdb3342 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:06:10.862412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:10.863318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 186/379] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:06:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:10.864190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e087f-d8bc-4fa0-839d-6f68acdb3342 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.871697 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9194d-371c-4e00-89b2-c0be9be3a8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.872328 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9194d-371c-4e00-89b2-c0be9be3a8ba None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.872607 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9194d-371c-4e00-89b2-c0be9be3a8ba None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.872878 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9194d-371c-4e00-89b2-c0be9be3a8ba None admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:10.873599 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9194d-371c-4e00-89b2-c0be9be3a8ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:10.873904 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9194d-371c-4e00-89b2-c0be9be3a8ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:10.875324 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9194d-371c-4e00-89b2-c0be9be3a8ba None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:10.911833 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 194/380] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Oct 20 19:06:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:10.913314 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9194d-371c-4e00-89b2-c0be9be3a8ba None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:10.963301 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e087f-d8bc-4fa0-839d-6f68acdb3342 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:10.996048 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb1ef9-36ba-4535-bea4-8f37a9266efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:10.996764 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1ef9-36ba-4535-bea4-8f37a9266efc None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:10.997036 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1ef9-36ba-4535-bea4-8f37a9266efc None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:10.997297 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb1ef9-36ba-4535-bea4-8f37a9266efc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.004377 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb1ef9-36ba-4535-bea4-8f37a9266efc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.005836 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb1ef9-36ba-4535-bea4-8f37a9266efc None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.013313 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9194d-371c-4e00-89b2-c0be9be3a8ba None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-90cb1ef9-36ba-4535-bea4-8f37a9266efc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:06:11.017006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:11.017922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:11.018814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:11.018814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:11.018814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:06:11.018814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:06:11.018814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:06:11.018814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:06:11.018814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:06:11.018814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:06:11.018814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 19:06:11.018814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:11.018814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 187/381] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:06:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:11.019827 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb1ef9-36ba-4535-bea4-8f37a9266efc None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.037474 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:11.049510 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0a863-4837-4723-8999-99177e5c3c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.050116 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a863-4837-4723-8999-99177e5c3c82 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.050391 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a863-4837-4723-8999-99177e5c3c82 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.050660 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0a863-4837-4723-8999-99177e5c3c82 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.051311 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0a863-4837-4723-8999-99177e5c3c82 None admin] RBAC: Adding query filter params (name=service) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:11.051609 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0a863-4837-4723-8999-99177e5c3c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.052999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0a863-4837-4723-8999-99177e5c3c82 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.060690 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 195/382] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 19:06:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:11.061455 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0a863-4837-4723-8999-99177e5c3c82 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.095598 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:11.122710 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb1ef9-36ba-4535-bea4-8f37a9266efc None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.155857 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4c999-b1ee-4e48-b5a4-cca8d789c449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.156472 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4c999-b1ee-4e48-b5a4-cca8d789c449 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.156744 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4c999-b1ee-4e48-b5a4-cca8d789c449 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.157010 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4c999-b1ee-4e48-b5a4-cca8d789c449 None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.157722 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4c999-b1ee-4e48-b5a4-cca8d789c449 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:11.158018 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4c999-b1ee-4e48-b5a4-cca8d789c449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.159432 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4c999-b1ee-4e48-b5a4-cca8d789c449 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.159649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0a863-4837-4723-8999-99177e5c3c82 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.192847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30c75c-a069-487a-b310-d08e99e157d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.193468 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30c75c-a069-487a-b310-d08e99e157d1 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.193744 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30c75c-a069-487a-b310-d08e99e157d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.194684 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30c75c-a069-487a-b310-d08e99e157d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.196206 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 188/383] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:11.197547 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4c999-b1ee-4e48-b5a4-cca8d789c449 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.205193 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30c75c-a069-487a-b310-d08e99e157d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.206646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30c75c-a069-487a-b310-d08e99e157d1 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-3d30c75c-a069-487a-b310-d08e99e157d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:11.220626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:11.221610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:11.222470 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:11.222470 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:11.222470 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:11.222470 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 196/384] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:11.222749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30c75c-a069-487a-b310-d08e99e157d1 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.270230 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:11.301560 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4c999-b1ee-4e48-b5a4-cca8d789c449 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.308783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:11.321230 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30c75c-a069-487a-b310-d08e99e157d1 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.335928 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb9718-21ca-476a-af5f-0848e130219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.336559 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb9718-21ca-476a-af5f-0848e130219a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.336847 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb9718-21ca-476a-af5f-0848e130219a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.337119 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb9718-21ca-476a-af5f-0848e130219a None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.337841 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb9718-21ca-476a-af5f-0848e130219a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:11.338147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb9718-21ca-476a-af5f-0848e130219a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.339580 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb9718-21ca-476a-af5f-0848e130219a None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.354681 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb4226-3f2c-496f-bce9-bbbbe48f85e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.355249 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb4226-3f2c-496f-bce9-bbbbe48f85e0 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.355525 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb4226-3f2c-496f-bce9-bbbbe48f85e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.355796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb4226-3f2c-496f-bce9-bbbbe48f85e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.356968 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 189/385] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:11.357759 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb9718-21ca-476a-af5f-0848e130219a None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.367627 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb4226-3f2c-496f-bce9-bbbbe48f85e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.369142 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb4226-3f2c-496f-bce9-bbbbe48f85e0 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-18bb4226-3f2c-496f-bce9-bbbbe48f85e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:11.383625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:11.384575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:11.385432 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:11.385432 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:11.385432 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:11.385432 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 197/386] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:11.385647 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb4226-3f2c-496f-bce9-bbbbe48f85e0 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.457362 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb9718-21ca-476a-af5f-0848e130219a None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.483087 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:11.488137 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb4226-3f2c-496f-bce9-bbbbe48f85e0 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.491287 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375133e-53c9-4d67-a79a-7143e99948bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.491899 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375133e-53c9-4d67-a79a-7143e99948bd None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.492169 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375133e-53c9-4d67-a79a-7143e99948bd None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.492466 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375133e-53c9-4d67-a79a-7143e99948bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.501994 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375133e-53c9-4d67-a79a-7143e99948bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.503418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375133e-53c9-4d67-a79a-7143e99948bd None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-2375133e-53c9-4d67-a79a-7143e99948bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:11.518125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:11.519039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:11.520091 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:11.520091 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:11.520091 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:11.520091 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 190/387] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:11.521479 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d733a6-2feb-443d-9c3b-b65225732cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.522204 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d733a6-2feb-443d-9c3b-b65225732cf6 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.522475 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d733a6-2feb-443d-9c3b-b65225732cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.522620 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375133e-53c9-4d67-a79a-7143e99948bd None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.522724 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d733a6-2feb-443d-9c3b-b65225732cf6 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.523362 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d733a6-2feb-443d-9c3b-b65225732cf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:11.523661 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d733a6-2feb-443d-9c3b-b65225732cf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.525074 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d733a6-2feb-443d-9c3b-b65225732cf6 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.533872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:11.542838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 198/388] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:11.542838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d733a6-2feb-443d-9c3b-b65225732cf6 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.622518 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375133e-53c9-4d67-a79a-7143e99948bd None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.646794 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d733a6-2feb-443d-9c3b-b65225732cf6 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.655065 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fca415-27f8-42bd-9a84-20e9939666be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.655683 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca415-27f8-42bd-9a84-20e9939666be None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.655962 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca415-27f8-42bd-9a84-20e9939666be None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.656231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fca415-27f8-42bd-9a84-20e9939666be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.666978 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fca415-27f8-42bd-9a84-20e9939666be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.668463 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fca415-27f8-42bd-9a84-20e9939666be None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.681663 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a608658-8057-4cb0-8493-aa2f4b5194a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.682258 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608658-8057-4cb0-8493-aa2f4b5194a8 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.682539 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608658-8057-4cb0-8493-aa2f4b5194a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-63fca415-27f8-42bd-9a84-20e9939666be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:11.682634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:11.683589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:11.684481 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:11.684481 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:11.684481 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:11.684662 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a608658-8057-4cb0-8493-aa2f4b5194a8 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.684662 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a608658-8057-4cb0-8493-aa2f4b5194a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:11.685170 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 191/389] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:11.685253 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a608658-8057-4cb0-8493-aa2f4b5194a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.685330 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fca415-27f8-42bd-9a84-20e9939666be None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.685399 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a608658-8057-4cb0-8493-aa2f4b5194a8 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.697625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 199/390] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:11.698459 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a608658-8057-4cb0-8493-aa2f4b5194a8 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.721156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:11.761080 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:11.789404 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fca415-27f8-42bd-9a84-20e9939666be None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.802456 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a608658-8057-4cb0-8493-aa2f4b5194a8 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.822152 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563c444-5414-4148-8a43-4316991f2d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.822749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563c444-5414-4148-8a43-4316991f2d75 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.823028 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563c444-5414-4148-8a43-4316991f2d75 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.823297 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563c444-5414-4148-8a43-4316991f2d75 None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.824078 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563c444-5414-4148-8a43-4316991f2d75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:11.824404 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563c444-5414-4148-8a43-4316991f2d75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.825770 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563c444-5414-4148-8a43-4316991f2d75 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.837403 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252d780-6b8b-4e31-853c-8cea7cbd1492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.837992 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 192/391] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:11.838116 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d780-6b8b-4e31-853c-8cea7cbd1492 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.838297 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d780-6b8b-4e31-853c-8cea7cbd1492 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.838571 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252d780-6b8b-4e31-853c-8cea7cbd1492 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.838770 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563c444-5414-4148-8a43-4316991f2d75 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.848826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252d780-6b8b-4e31-853c-8cea7cbd1492 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.850391 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252d780-6b8b-4e31-853c-8cea7cbd1492 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-c252d780-6b8b-4e31-853c-8cea7cbd1492 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:06:11.861767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:11.862786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:11.863908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:06:11.863908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:06:11.863908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:06:11.863908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:06:11.863908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:06:11.863908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:06:11.863908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:11.863908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:11.863908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 200/392] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:11.863908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252d780-6b8b-4e31-853c-8cea7cbd1492 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.934040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:11.943288 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563c444-5414-4148-8a43-4316991f2d75 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.961981 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252d780-6b8b-4e31-853c-8cea7cbd1492 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:11.976955 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bed8b6-a624-4e6c-a65f-fcb41bc08097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.977543 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed8b6-a624-4e6c-a65f-fcb41bc08097 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.977811 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed8b6-a624-4e6c-a65f-fcb41bc08097 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.978074 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bed8b6-a624-4e6c-a65f-fcb41bc08097 None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:11.978699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bed8b6-a624-4e6c-a65f-fcb41bc08097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:11.978995 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bed8b6-a624-4e6c-a65f-fcb41bc08097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:11.980373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bed8b6-a624-4e6c-a65f-fcb41bc08097 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:11.982180 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:11.991626 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 193/393] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:11.992324 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bed8b6-a624-4e6c-a65f-fcb41bc08097 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:11.996654 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f0e33-a49b-48e2-b05c-211d27584828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:11.997277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f0e33-a49b-48e2-b05c-211d27584828 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:11.997557 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f0e33-a49b-48e2-b05c-211d27584828 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:11.997824 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f0e33-a49b-48e2-b05c-211d27584828 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:12.005394 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f0e33-a49b-48e2-b05c-211d27584828 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:12.007902 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f0e33-a49b-48e2-b05c-211d27584828 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-eb8f0e33-a49b-48e2-b05c-211d27584828 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:06:12.018873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:12.019796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:12.020746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:12.020746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:12.020746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:06:12.020746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:06:12.020746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:06:12.020746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:06:12.020746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:06:12.020746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:06:12.020746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 19:06:12.020746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:12.020746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 201/394] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:12.021309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f0e33-a49b-48e2-b05c-211d27584828 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:12.093755 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bed8b6-a624-4e6c-a65f-fcb41bc08097 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:12.122550 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f0e33-a49b-48e2-b05c-211d27584828 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:12.126510 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948622fa-6351-4b27-b959-8b881cd2c04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:12.127117 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948622fa-6351-4b27-b959-8b881cd2c04b None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:12.127391 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948622fa-6351-4b27-b959-8b881cd2c04b None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:12.127656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948622fa-6351-4b27-b959-8b881cd2c04b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:12.134857 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948622fa-6351-4b27-b959-8b881cd2c04b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:12.136299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948622fa-6351-4b27-b959-8b881cd2c04b None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-948622fa-6351-4b27-b959-8b881cd2c04b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:06:12.148621 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:12.149645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:12.150656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:06:12.150656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:06:12.150656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:06:12.150656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:06:12.150656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:06:12.150656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:06:12.150656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:12.150656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:12.150656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 194/395] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:12.150656 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948622fa-6351-4b27-b959-8b881cd2c04b None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:12.158290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b249a-f5e8-4117-9580-1744f6255451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:12.158883 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b249a-f5e8-4117-9580-1744f6255451 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:12.159159 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b249a-f5e8-4117-9580-1744f6255451 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:12.159430 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b249a-f5e8-4117-9580-1744f6255451 None admin] PATH_INFO: `/v3/projects` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:12.160107 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b249a-f5e8-4117-9580-1744f6255451 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:12.160457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b249a-f5e8-4117-9580-1744f6255451 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:12.161872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b249a-f5e8-4117-9580-1744f6255451 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:12.167248 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:12.180222 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 202/396] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:06:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:12.181268 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b249a-f5e8-4117-9580-1744f6255451 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:12.224341 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:12.255320 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948622fa-6351-4b27-b959-8b881cd2c04b None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:12.281974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b249a-f5e8-4117-9580-1744f6255451 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:12.288406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88485102-d700-4bb4-a432-29e864d2b720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:12.289022 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88485102-d700-4bb4-a432-29e864d2b720 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:12.289305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88485102-d700-4bb4-a432-29e864d2b720 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:12.289574 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88485102-d700-4bb4-a432-29e864d2b720 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:12.296991 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88485102-d700-4bb4-a432-29e864d2b720 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:12.298424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88485102-d700-4bb4-a432-29e864d2b720 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-88485102-d700-4bb4-a432-29e864d2b720 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:06:12.309454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:12.310424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:12.311819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:06:12.311819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:06:12.311819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:06:12.311819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:06:12.311819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:06:12.311819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:06:12.311819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:12.311819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:12.311819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 195/397] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:12.315808 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88485102-d700-4bb4-a432-29e864d2b720 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:12.315930 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e5f1-b54f-4c44-896d-c8d5a81c5737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:12.316581 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e5f1-b54f-4c44-896d-c8d5a81c5737 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:12.316859 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e5f1-b54f-4c44-896d-c8d5a81c5737 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:12.317126 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e5f1-b54f-4c44-896d-c8d5a81c5737 None admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:12.317850 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0e5f1-b54f-4c44-896d-c8d5a81c5737 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:12.318158 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0e5f1-b54f-4c44-896d-c8d5a81c5737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:12.320221 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0e5f1-b54f-4c44-896d-c8d5a81c5737 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:12.337441 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 203/398] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Oct 20 19:06:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:12.338199 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e5f1-b54f-4c44-896d-c8d5a81c5737 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:12.384044 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:12.414866 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88485102-d700-4bb4-a432-29e864d2b720 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:12.431880 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:12.435735 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e5f1-b54f-4c44-896d-c8d5a81c5737 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:12.449158 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57df4-502f-42df-b346-3ad423c9e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:12.449754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57df4-502f-42df-b346-3ad423c9e69a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:12.450026 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57df4-502f-42df-b346-3ad423c9e69a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:12.450299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57df4-502f-42df-b346-3ad423c9e69a None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:12.451010 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f57df4-502f-42df-b346-3ad423c9e69a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:12.451314 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f57df4-502f-42df-b346-3ad423c9e69a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:12.452764 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f57df4-502f-42df-b346-3ad423c9e69a None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:12.469372 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5355092-ba46-4cdb-aa48-f132218cc500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:12.475391 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 196/399] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:06:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:12.475516 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355092-ba46-4cdb-aa48-f132218cc500 None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:12.475616 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57df4-502f-42df-b346-3ad423c9e69a None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:12.475701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355092-ba46-4cdb-aa48-f132218cc500 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:12.475701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355092-ba46-4cdb-aa48-f132218cc500 None admin] PATH_INFO: `/v3/projects/75fce313b5e242adb9eb825bc017e358/users/cc6df159e6dc419cae222ebc3e5c99f4/roles/88986c4f59104ec0b79504be9dc10243` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:12.489802 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5355092-ba46-4cdb-aa48-f132218cc500 None admin] RBAC: Authorizing `identity:create_grant(project_id=75fce313b5e242adb9eb825bc017e358, user_id=cc6df159e6dc419cae222ebc3e5c99f4, role_id=88986c4f59104ec0b79504be9dc10243)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:12.491728 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5355092-ba46-4cdb-aa48-f132218cc500 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:12.504533 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 204/400] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:06:12 2022] PUT /identity/v3/projects/75fce313b5e242adb9eb825bc017e358/users/cc6df159e6dc419cae222ebc3e5c99f4/roles/88986c4f59104ec0b79504be9dc10243 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:06:12.505299 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5355092-ba46-4cdb-aa48-f132218cc500 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:12.607516 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57df4-502f-42df-b346-3ad423c9e69a None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:12.618237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5355092-ba46-4cdb-aa48-f132218cc500 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:12.639936 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:12.646995 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178945-73a7-46c4-8885-f2956f87c052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:12.647729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178945-73a7-46c4-8885-f2956f87c052 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:12.648097 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178945-73a7-46c4-8885-f2956f87c052 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:12.648405 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178945-73a7-46c4-8885-f2956f87c052 None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:12.649103 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca178945-73a7-46c4-8885-f2956f87c052 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:12.649404 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca178945-73a7-46c4-8885-f2956f87c052 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:12.650855 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca178945-73a7-46c4-8885-f2956f87c052 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:12.656786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2834ea0-bb5d-45b8-ba56-3c3ef7dc7111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:12.657432 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2834ea0-bb5d-45b8-ba56-3c3ef7dc7111 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:12.657711 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2834ea0-bb5d-45b8-ba56-3c3ef7dc7111 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:12.657985 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2834ea0-bb5d-45b8-ba56-3c3ef7dc7111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:12.664083 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 197/401] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:06:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:12.664937 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178945-73a7-46c4-8885-f2956f87c052 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:12.675576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2834ea0-bb5d-45b8-ba56-3c3ef7dc7111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:12.678066 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2834ea0-bb5d-45b8-ba56-3c3ef7dc7111 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:12.693501 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-a2834ea0-bb5d-45b8-ba56-3c3ef7dc7111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:12.702334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:12.703323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:12.704176 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:12.704176 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:12.704176 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:12.708570 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 205/402] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:12.709492 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2834ea0-bb5d-45b8-ba56-3c3ef7dc7111 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:12.784410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178945-73a7-46c4-8885-f2956f87c052 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:12.817526 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5986-356e-443e-bd90-d137d1ad6819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:12.818276 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5986-356e-443e-bd90-d137d1ad6819 None admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:12.818554 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5986-356e-443e-bd90-d137d1ad6819 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:12.819331 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5986-356e-443e-bd90-d137d1ad6819 None admin] PATH_INFO: `/v3/projects/75fce313b5e242adb9eb825bc017e358/users/3b28a7b6a48d48f5a23741ad142c93ce/roles/88986c4f59104ec0b79504be9dc10243` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:12.821912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2834ea0-bb5d-45b8-ba56-3c3ef7dc7111 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:12.836784 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f5986-356e-443e-bd90-d137d1ad6819 None admin] RBAC: Authorizing `identity:create_grant(project_id=75fce313b5e242adb9eb825bc017e358, user_id=3b28a7b6a48d48f5a23741ad142c93ce, role_id=88986c4f59104ec0b79504be9dc10243)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:12.838268 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f5986-356e-443e-bd90-d137d1ad6819 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:12.853779 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 198/403] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:06:12 2022] PUT /identity/v3/projects/75fce313b5e242adb9eb825bc017e358/users/3b28a7b6a48d48f5a23741ad142c93ce/roles/88986c4f59104ec0b79504be9dc10243 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:06:12.854786 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5986-356e-443e-bd90-d137d1ad6819 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:12.881134 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e314e4-ca71-4516-8600-c8ae0af49c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:12.882490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e314e4-ca71-4516-8600-c8ae0af49c49 None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:12.882936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e314e4-ca71-4516-8600-c8ae0af49c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:12.883337 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e314e4-ca71-4516-8600-c8ae0af49c49 None admin] PATH_INFO: `/v3/projects/75fce313b5e242adb9eb825bc017e358/users/b3e19f1878d042b295d1f75a3a781419/roles/88986c4f59104ec0b79504be9dc10243` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:12.907946 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e314e4-ca71-4516-8600-c8ae0af49c49 None admin] RBAC: Authorizing `identity:create_grant(project_id=75fce313b5e242adb9eb825bc017e358, user_id=b3e19f1878d042b295d1f75a3a781419, role_id=88986c4f59104ec0b79504be9dc10243)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:12.910578 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:12.911588 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e314e4-ca71-4516-8600-c8ae0af49c49 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:12.937391 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 206/404] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:06:12 2022] PUT /identity/v3/projects/75fce313b5e242adb9eb825bc017e358/users/b3e19f1878d042b295d1f75a3a781419/roles/88986c4f59104ec0b79504be9dc10243 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:06:12.992304 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5986-356e-443e-bd90-d137d1ad6819 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:13.035317 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc7bf0-2ce4-41c7-8bc8-3a123a7a7f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:13.035905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc7bf0-2ce4-41c7-8bc8-3a123a7a7f6f None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:13.036189 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc7bf0-2ce4-41c7-8bc8-3a123a7a7f6f None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:13.036507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc7bf0-2ce4-41c7-8bc8-3a123a7a7f6f None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:13.037178 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc7bf0-2ce4-41c7-8bc8-3a123a7a7f6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:13.037988 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc7bf0-2ce4-41c7-8bc8-3a123a7a7f6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:13.039705 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc7bf0-2ce4-41c7-8bc8-3a123a7a7f6f None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:13.054316 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 199/405] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:13.060044 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e314e4-ca71-4516-8600-c8ae0af49c49 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:13.120853 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:13.179069 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e314e4-ca71-4516-8600-c8ae0af49c49 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:13.215070 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0bac1-3a6c-4f23-8d91-53735dab4224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:13.215704 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0bac1-3a6c-4f23-8d91-53735dab4224 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:13.216043 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0bac1-3a6c-4f23-8d91-53735dab4224 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:13.216347 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0bac1-3a6c-4f23-8d91-53735dab4224 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:13.223485 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0bac1-3a6c-4f23-8d91-53735dab4224 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:13.225029 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0bac1-3a6c-4f23-8d91-53735dab4224 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-3af0bac1-3a6c-4f23-8d91-53735dab4224 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:06:13.236772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:13.237630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:13.238460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:06:13.238460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:06:13.238460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:06:13.238460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:06:13.238460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:06:13.238460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:06:13.238460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:13.238460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:13.238460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 207/406] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:13.245548 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc7bf0-2ce4-41c7-8bc8-3a123a7a7f6f None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:13.351495 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc7bf0-2ce4-41c7-8bc8-3a123a7a7f6f None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:13.353083 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:13.389351 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79942447-e46c-438b-816e-405dc34bf593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:13.389954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942447-e46c-438b-816e-405dc34bf593 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:13.390237 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942447-e46c-438b-816e-405dc34bf593 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:13.390508 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942447-e46c-438b-816e-405dc34bf593 None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:13.391199 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79942447-e46c-438b-816e-405dc34bf593 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:13.391505 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79942447-e46c-438b-816e-405dc34bf593 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:13.392966 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79942447-e46c-438b-816e-405dc34bf593 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:13.405539 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 200/407] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:13.411636 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0bac1-3a6c-4f23-8d91-53735dab4224 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:13.518759 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0bac1-3a6c-4f23-8d91-53735dab4224 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:13.529932 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:13.555287 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c838c-ed7e-4568-8af2-2123fef1747b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:13.555944 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c838c-ed7e-4568-8af2-2123fef1747b None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:13.556225 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c838c-ed7e-4568-8af2-2123fef1747b None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:13.556530 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c838c-ed7e-4568-8af2-2123fef1747b None admin] PATH_INFO: `/v3/projects/75fce313b5e242adb9eb825bc017e358/users/09fce752a3264bb19af1260da2b83315/roles/88986c4f59104ec0b79504be9dc10243` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:13.571503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c838c-ed7e-4568-8af2-2123fef1747b None admin] RBAC: Authorizing `identity:create_grant(project_id=75fce313b5e242adb9eb825bc017e358, user_id=09fce752a3264bb19af1260da2b83315, role_id=88986c4f59104ec0b79504be9dc10243)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:13.572965 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c838c-ed7e-4568-8af2-2123fef1747b None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:13.589266 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 208/408] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:06:13 2022] PUT /identity/v3/projects/75fce313b5e242adb9eb825bc017e358/users/09fce752a3264bb19af1260da2b83315/roles/88986c4f59104ec0b79504be9dc10243 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:06:15.009581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2bb89-83ad-4841-a82f-3104adba0b7d None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:15.010088 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2bb89-83ad-4841-a82f-3104adba0b7d None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:15.010088 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2bb89-83ad-4841-a82f-3104adba0b7d None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:15.011428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 201/409] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:15.017407 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1f6a7-16b8-463d-b0e5-12db42b6cca0 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:15.017975 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1f6a7-16b8-463d-b0e5-12db42b6cca0 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:15.018179 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1f6a7-16b8-463d-b0e5-12db42b6cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:15.039243 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-93b1f6a7-16b8-463d-b0e5-12db42b6cca0 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:15.040514 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-93b1f6a7-16b8-463d-b0e5-12db42b6cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:15.117747 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 209/410] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:15.390973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2815f1-819d-449c-9fbf-e2a670a561ca None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:15.391321 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2815f1-819d-449c-9fbf-e2a670a561ca None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:15.391495 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2815f1-819d-449c-9fbf-e2a670a561ca None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:15.393059 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 202/411] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:15.400732 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1803-952c-4bf1-8339-aeb01c5b51ee None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:15.401126 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1803-952c-4bf1-8339-aeb01c5b51ee None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:15.401503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d1803-952c-4bf1-8339-aeb01c5b51ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:15.420189 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-220d1803-952c-4bf1-8339-aeb01c5b51ee None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:15.421403 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-220d1803-952c-4bf1-8339-aeb01c5b51ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:15.454084 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2815f1-819d-449c-9fbf-e2a670a561ca None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:15.497041 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 210/412] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:15.498348 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def669f-b519-4d17-8697-500ef5142483 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:15.498582 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def669f-b519-4d17-8697-500ef5142483 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:15.498851 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def669f-b519-4d17-8697-500ef5142483 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:15.500329 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 211/413] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:15.509660 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ee93d-7ab9-4969-b16a-b059ab9c103d None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:15.509947 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ee93d-7ab9-4969-b16a-b059ab9c103d None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:15.510221 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ee93d-7ab9-4969-b16a-b059ab9c103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:15.531125 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-cf8ee93d-7ab9-4969-b16a-b059ab9c103d None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:15.532329 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-cf8ee93d-7ab9-4969-b16a-b059ab9c103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:15.550637 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:15.578127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2815f1-819d-449c-9fbf-e2a670a561ca None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:15.620426 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 212/414] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:15.624287 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408b8b3-53a5-4624-bfa0-e9491e9cb350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:15.625186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408b8b3-53a5-4624-bfa0-e9491e9cb350 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:15.625650 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408b8b3-53a5-4624-bfa0-e9491e9cb350 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:15.626127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408b8b3-53a5-4624-bfa0-e9491e9cb350 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:15.637509 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408b8b3-53a5-4624-bfa0-e9491e9cb350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-d408b8b3-53a5-4624-bfa0-e9491e9cb350 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:15.642677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:15.643635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:15.644454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:15.647662 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 203/415] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:06:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:15.653961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ee93d-7ab9-4969-b16a-b059ab9c103d None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:15.760809 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ee93d-7ab9-4969-b16a-b059ab9c103d None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:15.796164 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1ee47-6bcb-46e8-b1ab-9cbd780cfaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:15.797137 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1ee47-6bcb-46e8-b1ab-9cbd780cfaf0 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:15.797621 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1ee47-6bcb-46e8-b1ab-9cbd780cfaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:15.798080 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1ee47-6bcb-46e8-b1ab-9cbd780cfaf0 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:15.798914 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1ee47-6bcb-46e8-b1ab-9cbd780cfaf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:15.799402 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1ee47-6bcb-46e8-b1ab-9cbd780cfaf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:15.800970 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1ee47-6bcb-46e8-b1ab-9cbd780cfaf0 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:15.810518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 213/416] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 19:06:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:15.816379 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408b8b3-53a5-4624-bfa0-e9491e9cb350 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:15.837807 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1ee47-6bcb-46e8-b1ab-9cbd780cfaf0 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:15.843365 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:15.853616 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:15.944655 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408b8b3-53a5-4624-bfa0-e9491e9cb350 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:15.959025 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1ee47-6bcb-46e8-b1ab-9cbd780cfaf0 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:15.981549 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110e1a0-1795-4bd8-af2b-637ba6068fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:15.982173 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110e1a0-1795-4bd8-af2b-637ba6068fcf None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:15.982448 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110e1a0-1795-4bd8-af2b-637ba6068fcf None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:15.982720 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110e1a0-1795-4bd8-af2b-637ba6068fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:15.992924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110e1a0-1795-4bd8-af2b-637ba6068fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:15.994492 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110e1a0-1795-4bd8-af2b-637ba6068fcf None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:15.997690 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5613fe-84c0-4ef5-9fd1-aaefa75d6993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:15.998316 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5613fe-84c0-4ef5-9fd1-aaefa75d6993 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:15.998593 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5613fe-84c0-4ef5-9fd1-aaefa75d6993 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:15.998856 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5613fe-84c0-4ef5-9fd1-aaefa75d6993 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-a110e1a0-1795-4bd8-af2b-637ba6068fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:16.009912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:16.011139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:16.012585 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:16.012585 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:16.012585 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:16.012748 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5613fe-84c0-4ef5-9fd1-aaefa75d6993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:16.012835 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 204/417] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:16.012835 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110e1a0-1795-4bd8-af2b-637ba6068fcf None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-1b5613fe-84c0-4ef5-9fd1-aaefa75d6993 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:16.020099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:16.021422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 214/418] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:06:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:06:16.024201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5613fe-84c0-4ef5-9fd1-aaefa75d6993 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.097402 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:16.097743 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:16.122876 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110e1a0-1795-4bd8-af2b-637ba6068fcf None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:16.129150 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5613fe-84c0-4ef5-9fd1-aaefa75d6993 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:16.155408 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c70e2a-b7f6-44b9-a8cf-e4638e53d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:16.156031 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c70e2a-b7f6-44b9-a8cf-e4638e53d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.156333 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c70e2a-b7f6-44b9-a8cf-e4638e53d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.156607 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c70e2a-b7f6-44b9-a8cf-e4638e53d3e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.163144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438cc20-191d-4b1c-ad02-de9faf535fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:16.164040 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438cc20-191d-4b1c-ad02-de9faf535fe9 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.164215 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438cc20-191d-4b1c-ad02-de9faf535fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.164513 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438cc20-191d-4b1c-ad02-de9faf535fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.165147 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438cc20-191d-4b1c-ad02-de9faf535fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:16.165445 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438cc20-191d-4b1c-ad02-de9faf535fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:16.167054 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438cc20-191d-4b1c-ad02-de9faf535fe9 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:16.167742 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c70e2a-b7f6-44b9-a8cf-e4638e53d3e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-06c70e2a-b7f6-44b9-a8cf-e4638e53d3e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:16.173290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:16.174156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:16.174939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 205/419] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:16.175585 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c70e2a-b7f6-44b9-a8cf-e4638e53d3e9 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.185096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 215/420] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:16.185096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16998f8-f02d-4086-af03-985873977647 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.185096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16998f8-f02d-4086-af03-985873977647 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.185096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16998f8-f02d-4086-af03-985873977647 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.185096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 216/421] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:16.185096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16998f8-f02d-4086-af03-985873977647 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.276619 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c70e2a-b7f6-44b9-a8cf-e4638e53d3e9 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:16.294148 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16998f8-f02d-4086-af03-985873977647 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:16.309927 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0543e-7fd9-43bd-ab95-ba08c48443ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:16.310521 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0543e-7fd9-43bd-ab95-ba08c48443ac None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.310796 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0543e-7fd9-43bd-ab95-ba08c48443ac None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.311073 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0543e-7fd9-43bd-ab95-ba08c48443ac None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.311722 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0543e-7fd9-43bd-ab95-ba08c48443ac None admin] RBAC: Adding query filter params (name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:16.312026 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0543e-7fd9-43bd-ab95-ba08c48443ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:16.313429 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0543e-7fd9-43bd-ab95-ba08c48443ac None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:16.314718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:16.322403 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 206/422] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:16.323036 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:16.323212 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0543e-7fd9-43bd-ab95-ba08c48443ac None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.328834 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b31db-49d1-4e55-bb6d-74a246363db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:16.329621 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b31db-49d1-4e55-bb6d-74a246363db1 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.330056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b31db-49d1-4e55-bb6d-74a246363db1 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.330492 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b31db-49d1-4e55-bb6d-74a246363db1 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.331149 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b31db-49d1-4e55-bb6d-74a246363db1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:16.331451 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b31db-49d1-4e55-bb6d-74a246363db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:16.332851 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b31db-49d1-4e55-bb6d-74a246363db1 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:16.341429 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 217/423] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:16.342709 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c35f-6740-45e9-bfc0-712a293ee6f1 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.343047 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c35f-6740-45e9-bfc0-712a293ee6f1 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.343317 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c35f-6740-45e9-bfc0-712a293ee6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.361856 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-5da6c35f-6740-45e9-bfc0-712a293ee6f1 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:16.363983 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-5da6c35f-6740-45e9-bfc0-712a293ee6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:16.425068 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0543e-7fd9-43bd-ab95-ba08c48443ac None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:16.433273 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 218/424] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:16.434273 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6c35f-6740-45e9-bfc0-712a293ee6f1 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.457498 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5db10-e2d2-426d-a98e-e8bd3839cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:16.458115 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5db10-e2d2-426d-a98e-e8bd3839cf60 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.458391 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5db10-e2d2-426d-a98e-e8bd3839cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.458653 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5db10-e2d2-426d-a98e-e8bd3839cf60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.467107 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5db10-e2d2-426d-a98e-e8bd3839cf60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:16.468571 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5db10-e2d2-426d-a98e-e8bd3839cf60 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-3dd5db10-e2d2-426d-a98e-e8bd3839cf60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:06:16.480617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:16.481532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 207/425] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:16.487128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5db10-e2d2-426d-a98e-e8bd3839cf60 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.547573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:16.551227 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6c35f-6740-45e9-bfc0-712a293ee6f1 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:16.578955 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:16.591383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca51c8-1fc0-469a-8a0b-1354d0dd8c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:16.592007 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca51c8-1fc0-469a-8a0b-1354d0dd8c5d None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.592302 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca51c8-1fc0-469a-8a0b-1354d0dd8c5d None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.592583 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca51c8-1fc0-469a-8a0b-1354d0dd8c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.595821 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5db10-e2d2-426d-a98e-e8bd3839cf60 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:16.603559 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca51c8-1fc0-469a-8a0b-1354d0dd8c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:16.605040 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca51c8-1fc0-469a-8a0b-1354d0dd8c5d None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-2aca51c8-1fc0-469a-8a0b-1354d0dd8c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:16.620563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:16.621649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:16.627490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:16.627490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:16.627490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:16.627490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 219/426] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:16.627490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca51c8-1fc0-469a-8a0b-1354d0dd8c5d None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.639977 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effd602-77ce-4920-9d42-35bcbacf04d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:16.640608 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effd602-77ce-4920-9d42-35bcbacf04d9 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.640885 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effd602-77ce-4920-9d42-35bcbacf04d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.641182 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effd602-77ce-4920-9d42-35bcbacf04d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.653065 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effd602-77ce-4920-9d42-35bcbacf04d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:16.654509 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effd602-77ce-4920-9d42-35bcbacf04d9 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-0effd602-77ce-4920-9d42-35bcbacf04d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:16.668783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:16.669854 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:16.670716 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:16.670716 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:16.670716 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:16.670716 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 208/427] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:16.670926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effd602-77ce-4920-9d42-35bcbacf04d9 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.747538 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca51c8-1fc0-469a-8a0b-1354d0dd8c5d None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:16.780565 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769099ac-c7ed-4842-8f29-f065c90ec583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:16.781157 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769099ac-c7ed-4842-8f29-f065c90ec583 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.781430 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769099ac-c7ed-4842-8f29-f065c90ec583 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.781697 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769099ac-c7ed-4842-8f29-f065c90ec583 None admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.782325 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effd602-77ce-4920-9d42-35bcbacf04d9 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:16.782419 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769099ac-c7ed-4842-8f29-f065c90ec583 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:16.782693 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769099ac-c7ed-4842-8f29-f065c90ec583 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:16.784098 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769099ac-c7ed-4842-8f29-f065c90ec583 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:16.791824 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:16.802141 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 220/428] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:16.802995 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769099ac-c7ed-4842-8f29-f065c90ec583 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.817197 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3367ca-0f13-4f0e-9015-1e046f86d41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:16.817792 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3367ca-0f13-4f0e-9015-1e046f86d41a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.818068 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3367ca-0f13-4f0e-9015-1e046f86d41a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.818333 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3367ca-0f13-4f0e-9015-1e046f86d41a None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.819114 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3367ca-0f13-4f0e-9015-1e046f86d41a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:16.819413 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3367ca-0f13-4f0e-9015-1e046f86d41a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:16.820887 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3367ca-0f13-4f0e-9015-1e046f86d41a None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:16.832233 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 209/429] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:16.833117 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3367ca-0f13-4f0e-9015-1e046f86d41a None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.837756 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:16.905047 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769099ac-c7ed-4842-8f29-f065c90ec583 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:16.932789 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3367ca-0f13-4f0e-9015-1e046f86d41a None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:16.938810 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850434d-82cc-4779-b5f5-78f99c8b05a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:16.939405 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850434d-82cc-4779-b5f5-78f99c8b05a3 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.939677 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850434d-82cc-4779-b5f5-78f99c8b05a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.939942 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850434d-82cc-4779-b5f5-78f99c8b05a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.940606 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850434d-82cc-4779-b5f5-78f99c8b05a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:16.940900 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850434d-82cc-4779-b5f5-78f99c8b05a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:16.942246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850434d-82cc-4779-b5f5-78f99c8b05a3 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:16.953939 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 221/430] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:16.957305 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850434d-82cc-4779-b5f5-78f99c8b05a3 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:16.969572 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46ac55-b4ca-4e6c-9e44-833ac54ae2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:16.970191 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46ac55-b4ca-4e6c-9e44-833ac54ae2ba None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:16.970468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46ac55-b4ca-4e6c-9e44-833ac54ae2ba None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:16.970737 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46ac55-b4ca-4e6c-9e44-833ac54ae2ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:16.981282 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46ac55-b4ca-4e6c-9e44-833ac54ae2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-7c46ac55-b4ca-4e6c-9e44-833ac54ae2ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:16.985972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:16.986906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:16.987726 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 210/431] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:16.988796 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46ac55-b4ca-4e6c-9e44-833ac54ae2ba None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:17.016876 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:17.051176 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:17.059467 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850434d-82cc-4779-b5f5-78f99c8b05a3 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:17.086873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46ac55-b4ca-4e6c-9e44-833ac54ae2ba None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:17.093065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc214a-4101-4b6d-adb1-51dc15775bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:17.093672 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc214a-4101-4b6d-adb1-51dc15775bed None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:17.093954 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc214a-4101-4b6d-adb1-51dc15775bed None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:17.094249 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc214a-4101-4b6d-adb1-51dc15775bed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:17.121086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a295e8d-0c03-4732-b7ca-6dfdb506f9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:17.121698 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a295e8d-0c03-4732-b7ca-6dfdb506f9f8 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:17.121973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a295e8d-0c03-4732-b7ca-6dfdb506f9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:17.122244 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a295e8d-0c03-4732-b7ca-6dfdb506f9f8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:17.129014 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a295e8d-0c03-4732-b7ca-6dfdb506f9f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:17.130450 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a295e8d-0c03-4732-b7ca-6dfdb506f9f8 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-6a295e8d-0c03-4732-b7ca-6dfdb506f9f8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:06:17.142332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:17.143406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 211/432] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:17.144312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a295e8d-0c03-4732-b7ca-6dfdb506f9f8 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:17.164106 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc214a-4101-4b6d-adb1-51dc15775bed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:17.165595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc214a-4101-4b6d-adb1-51dc15775bed None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:17.233087 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:17.246070 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a295e8d-0c03-4732-b7ca-6dfdb506f9f8 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:17.257335 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:17.264393 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 222/433] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:06:17.265193 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc214a-4101-4b6d-adb1-51dc15775bed None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:17.278619 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e21db-1380-40db-8612-75d5fb22d541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:17.279226 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e21db-1380-40db-8612-75d5fb22d541 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:17.279495 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e21db-1380-40db-8612-75d5fb22d541 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:17.279757 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e21db-1380-40db-8612-75d5fb22d541 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:17.287073 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e21db-1380-40db-8612-75d5fb22d541 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:17.289078 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e21db-1380-40db-8612-75d5fb22d541 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-0c6e21db-1380-40db-8612-75d5fb22d541 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:06:17.300032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:17.300967 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 212/434] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:06:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:17.301849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e21db-1380-40db-8612-75d5fb22d541 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:17.367200 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc214a-4101-4b6d-adb1-51dc15775bed None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:17.399115 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e21db-1380-40db-8612-75d5fb22d541 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:17.400344 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c7b02-cdf4-40a3-a778-0b1bd13359b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:17.400945 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c7b02-cdf4-40a3-a778-0b1bd13359b8 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:17.401222 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c7b02-cdf4-40a3-a778-0b1bd13359b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:17.401502 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c7b02-cdf4-40a3-a778-0b1bd13359b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:17.402154 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c7b02-cdf4-40a3-a778-0b1bd13359b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:17.402457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c7b02-cdf4-40a3-a778-0b1bd13359b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:17.403822 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c7b02-cdf4-40a3-a778-0b1bd13359b8 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:17.411567 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 223/435] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 19:06:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:17.412958 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c7b02-cdf4-40a3-a778-0b1bd13359b8 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:17.436533 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d8041-474d-4146-a6fe-a59e1aeeeb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:17.437199 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d8041-474d-4146-a6fe-a59e1aeeeb2c None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:17.437470 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d8041-474d-4146-a6fe-a59e1aeeeb2c None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:17.437735 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d8041-474d-4146-a6fe-a59e1aeeeb2c None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:17.438446 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d8041-474d-4146-a6fe-a59e1aeeeb2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:17.438744 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d8041-474d-4146-a6fe-a59e1aeeeb2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:17.440199 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d8041-474d-4146-a6fe-a59e1aeeeb2c None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:17.457163 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 213/436] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Oct 20 19:06:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:17.457945 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d8041-474d-4146-a6fe-a59e1aeeeb2c None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:17.466496 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:17.468351 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:17.513354 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c7b02-cdf4-40a3-a778-0b1bd13359b8 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:17.546711 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108fa7e-c3d6-4085-89a4-0037b7f16fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:17.547327 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108fa7e-c3d6-4085-89a4-0037b7f16fe1 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:17.547599 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108fa7e-c3d6-4085-89a4-0037b7f16fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:17.547865 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108fa7e-c3d6-4085-89a4-0037b7f16fe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:17.556555 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d8041-474d-4146-a6fe-a59e1aeeeb2c None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:17.558158 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108fa7e-c3d6-4085-89a4-0037b7f16fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:17.559575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108fa7e-c3d6-4085-89a4-0037b7f16fe1 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-f108fa7e-c3d6-4085-89a4-0037b7f16fe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:17.573600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:17.574499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:17.575360 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:17.575360 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:17.575360 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:17.575360 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 224/437] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:17.575580 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108fa7e-c3d6-4085-89a4-0037b7f16fe1 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:17.589662 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624ae80-e9df-49e6-93a5-792585759fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:17.590250 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624ae80-e9df-49e6-93a5-792585759fbb None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:17.590519 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624ae80-e9df-49e6-93a5-792585759fbb None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:17.590781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624ae80-e9df-49e6-93a5-792585759fbb None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:17.591491 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624ae80-e9df-49e6-93a5-792585759fbb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:17.591791 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624ae80-e9df-49e6-93a5-792585759fbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:17.593230 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624ae80-e9df-49e6-93a5-792585759fbb None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:17.610719 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 214/438] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Oct 20 19:06:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:17.611515 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624ae80-e9df-49e6-93a5-792585759fbb None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:17.671022 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:17.673765 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108fa7e-c3d6-4085-89a4-0037b7f16fe1 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:17.682625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:17.707354 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d59d48-5be7-497b-b16f-28027fbefe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:17.707985 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d59d48-5be7-497b-b16f-28027fbefe7b None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:17.708258 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d59d48-5be7-497b-b16f-28027fbefe7b None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:17.708556 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d59d48-5be7-497b-b16f-28027fbefe7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:17.715215 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624ae80-e9df-49e6-93a5-792585759fbb None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:17.720069 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d59d48-5be7-497b-b16f-28027fbefe7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:17.721544 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d59d48-5be7-497b-b16f-28027fbefe7b None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-49d59d48-5be7-497b-b16f-28027fbefe7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:17.736203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:17.737161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:17.738083 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:17.738083 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:17.738083 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:17.738083 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 225/439] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:17.738083 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d59d48-5be7-497b-b16f-28027fbefe7b None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:17.750098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549e711-c876-4581-bbf9-3c9adb9f0bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:17.750687 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549e711-c876-4581-bbf9-3c9adb9f0bbf None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:17.750959 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549e711-c876-4581-bbf9-3c9adb9f0bbf None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:17.751226 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549e711-c876-4581-bbf9-3c9adb9f0bbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:17.817544 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549e711-c876-4581-bbf9-3c9adb9f0bbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:17.819104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549e711-c876-4581-bbf9-3c9adb9f0bbf None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:17.837180 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d59d48-5be7-497b-b16f-28027fbefe7b None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:17.869687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874fb14-0e05-42ec-90c6-9b86cca40be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:17.870280 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874fb14-0e05-42ec-90c6-9b86cca40be5 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:17.870555 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874fb14-0e05-42ec-90c6-9b86cca40be5 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:17.870828 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874fb14-0e05-42ec-90c6-9b86cca40be5 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:17.871458 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874fb14-0e05-42ec-90c6-9b86cca40be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:17.871764 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874fb14-0e05-42ec-90c6-9b86cca40be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:17.873146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874fb14-0e05-42ec-90c6-9b86cca40be5 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:17.877167 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:17.885576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 226/440] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:17.886376 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874fb14-0e05-42ec-90c6-9b86cca40be5 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:17.907085 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:17.919024 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 215/441] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:06:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:06:17.919713 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549e711-c876-4581-bbf9-3c9adb9f0bbf None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:17.991710 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874fb14-0e05-42ec-90c6-9b86cca40be5 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.014454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549e711-c876-4581-bbf9-3c9adb9f0bbf None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.025556 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b3bd6-2724-4831-b8ae-2eb5b43eb76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:18.026166 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b3bd6-2724-4831-b8ae-2eb5b43eb76d None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:18.026443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b3bd6-2724-4831-b8ae-2eb5b43eb76d None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:18.026714 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b3bd6-2724-4831-b8ae-2eb5b43eb76d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:18.048380 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370458-9959-491a-b3bf-93e953979eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:18.049382 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370458-9959-491a-b3bf-93e953979eac None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:18.049657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370458-9959-491a-b3bf-93e953979eac None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:18.049932 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370458-9959-491a-b3bf-93e953979eac None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:18.050560 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370458-9959-491a-b3bf-93e953979eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:18.050858 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370458-9959-491a-b3bf-93e953979eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:18.052234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370458-9959-491a-b3bf-93e953979eac None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:18.063706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 216/442] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:18.064520 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370458-9959-491a-b3bf-93e953979eac None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:18.088409 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:18.096473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b3bd6-2724-4831-b8ae-2eb5b43eb76d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:18.097924 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b3bd6-2724-4831-b8ae-2eb5b43eb76d None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:18.117824 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:18.163677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370458-9959-491a-b3bf-93e953979eac None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.200429 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 227/443] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:06:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:06:18.200429 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b3bd6-2724-4831-b8ae-2eb5b43eb76d None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:18.202268 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5de5d9-c207-4668-bcd1-2e15c85ad8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:18.202889 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5de5d9-c207-4668-bcd1-2e15c85ad8e4 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:18.203165 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5de5d9-c207-4668-bcd1-2e15c85ad8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:18.203432 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5de5d9-c207-4668-bcd1-2e15c85ad8e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:18.210859 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5de5d9-c207-4668-bcd1-2e15c85ad8e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:18.212328 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5de5d9-c207-4668-bcd1-2e15c85ad8e4 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-ea5de5d9-c207-4668-bcd1-2e15c85ad8e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:06:18.223254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:18.224100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:18.225507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:06:18.225507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:06:18.225507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:06:18.225507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:06:18.225507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:06:18.225507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:06:18.225507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:18.225507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:18.225507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 217/444] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:18.226208 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5de5d9-c207-4668-bcd1-2e15c85ad8e4 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:18.297671 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b3bd6-2724-4831-b8ae-2eb5b43eb76d None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.309959 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:18.317680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:18.326535 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5de5d9-c207-4668-bcd1-2e15c85ad8e4 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.331943 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e5e53-1bec-4217-9b7b-4bdbaa7deeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:18.332594 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e5e53-1bec-4217-9b7b-4bdbaa7deeb1 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:18.332869 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e5e53-1bec-4217-9b7b-4bdbaa7deeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:18.333135 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e5e53-1bec-4217-9b7b-4bdbaa7deeb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:18.343472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e5e53-1bec-4217-9b7b-4bdbaa7deeb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:18.344937 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e5e53-1bec-4217-9b7b-4bdbaa7deeb1 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:18.359422 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94054e6-69e8-442a-8e70-f9913da24eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-af4e5e53-1bec-4217-9b7b-4bdbaa7deeb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:18.359574 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:18.360670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:18.361526 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:18.361526 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:18.361526 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:18.361689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94054e6-69e8-442a-8e70-f9913da24eb8 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:18.361689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94054e6-69e8-442a-8e70-f9913da24eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:18.361689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94054e6-69e8-442a-8e70-f9913da24eb8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:18.361865 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 228/445] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:18.361865 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e5e53-1bec-4217-9b7b-4bdbaa7deeb1 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:18.373756 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94054e6-69e8-442a-8e70-f9913da24eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:18.375612 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94054e6-69e8-442a-8e70-f9913da24eb8 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-b94054e6-69e8-442a-8e70-f9913da24eb8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:06:18.387850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:18.388818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 218/446] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:06:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:18.389700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94054e6-69e8-442a-8e70-f9913da24eb8 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:18.466588 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e5e53-1bec-4217-9b7b-4bdbaa7deeb1 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.489187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94054e6-69e8-442a-8e70-f9913da24eb8 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.500690 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc643702-3671-404c-a922-27f4009a93b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:18.501308 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc643702-3671-404c-a922-27f4009a93b4 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:18.501584 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc643702-3671-404c-a922-27f4009a93b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:18.501854 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc643702-3671-404c-a922-27f4009a93b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:18.513295 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc643702-3671-404c-a922-27f4009a93b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:18.514727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc643702-3671-404c-a922-27f4009a93b4 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:18.525342 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d12b1-7b32-4de3-bae8-3065f5bcabdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:18.525932 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d12b1-7b32-4de3-bae8-3065f5bcabdc None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:18.526232 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d12b1-7b32-4de3-bae8-3065f5bcabdc None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:18.526500 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d12b1-7b32-4de3-bae8-3065f5bcabdc None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:18.527179 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d12b1-7b32-4de3-bae8-3065f5bcabdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:18.527508 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d12b1-7b32-4de3-bae8-3065f5bcabdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:18.528959 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d12b1-7b32-4de3-bae8-3065f5bcabdc None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-fc643702-3671-404c-a922-27f4009a93b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:18.529509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:18.530428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:18.531374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:18.531374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:18.531374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:18.531374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 229/447] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:18.533083 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc643702-3671-404c-a922-27f4009a93b4 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:18.541185 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 219/448] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:06:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:18.542139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d12b1-7b32-4de3-bae8-3065f5bcabdc None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:18.545590 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:18.562744 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:18.635329 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc643702-3671-404c-a922-27f4009a93b4 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.637707 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d12b1-7b32-4de3-bae8-3065f5bcabdc None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.668623 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fea90-d819-4b1e-a2ba-101a4da1cdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:18.669210 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fea90-d819-4b1e-a2ba-101a4da1cdc1 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:18.669483 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fea90-d819-4b1e-a2ba-101a4da1cdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:18.669748 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fea90-d819-4b1e-a2ba-101a4da1cdc1 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:18.670373 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fea90-d819-4b1e-a2ba-101a4da1cdc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:18.670671 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fea90-d819-4b1e-a2ba-101a4da1cdc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:18.671213 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b85e0-ad09-4dd6-9332-86348e9deb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:18.671798 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b85e0-ad09-4dd6-9332-86348e9deb10 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:18.672021 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fea90-d819-4b1e-a2ba-101a4da1cdc1 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:18.672117 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b85e0-ad09-4dd6-9332-86348e9deb10 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:18.672349 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b85e0-ad09-4dd6-9332-86348e9deb10 None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:18.673054 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b85e0-ad09-4dd6-9332-86348e9deb10 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:18.673353 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b85e0-ad09-4dd6-9332-86348e9deb10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:18.674737 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b85e0-ad09-4dd6-9332-86348e9deb10 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:18.683316 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 230/449] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:18.684099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fea90-d819-4b1e-a2ba-101a4da1cdc1 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:18.696094 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 220/450] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Oct 20 19:06:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:18.696949 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b85e0-ad09-4dd6-9332-86348e9deb10 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:18.760118 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:18.775536 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:18.791853 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fea90-d819-4b1e-a2ba-101a4da1cdc1 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.798043 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b85e0-ad09-4dd6-9332-86348e9deb10 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.825423 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e6886-52a2-4fa2-a62d-3ca7556a1737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:18.825957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e6886-52a2-4fa2-a62d-3ca7556a1737 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:18.826236 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e6886-52a2-4fa2-a62d-3ca7556a1737 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:18.826505 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e6886-52a2-4fa2-a62d-3ca7556a1737 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:18.827138 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e6886-52a2-4fa2-a62d-3ca7556a1737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:18.827446 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e6886-52a2-4fa2-a62d-3ca7556a1737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:18.828853 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e6886-52a2-4fa2-a62d-3ca7556a1737 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:18.831338 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15837ad5-3cec-4200-832a-7c14db7f2f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:18.831930 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15837ad5-3cec-4200-832a-7c14db7f2f48 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:18.832203 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15837ad5-3cec-4200-832a-7c14db7f2f48 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:18.832500 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15837ad5-3cec-4200-832a-7c14db7f2f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:18.833206 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15837ad5-3cec-4200-832a-7c14db7f2f48 None admin] RBAC: Adding query filter params (role.id=88986c4f59104ec0b79504be9dc10243, scope.project.id=75fce313b5e242adb9eb825bc017e358, user.id=cc6df159e6dc419cae222ebc3e5c99f4) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:18.833506 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15837ad5-3cec-4200-832a-7c14db7f2f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:18.836042 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15837ad5-3cec-4200-832a-7c14db7f2f48 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:18.840307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 231/451] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:18.841099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e6886-52a2-4fa2-a62d-3ca7556a1737 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:18.853850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 221/452] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:06:18 2022] GET /identity/v3/role_assignments?user.id=cc6df159e6dc419cae222ebc3e5c99f4&scope.project.id=75fce313b5e242adb9eb825bc017e358&role.id=88986c4f59104ec0b79504be9dc10243 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:18.853850 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15837ad5-3cec-4200-832a-7c14db7f2f48 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:18.963470 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15837ad5-3cec-4200-832a-7c14db7f2f48 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.968813 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e6886-52a2-4fa2-a62d-3ca7556a1737 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:18.993024 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:19.002805 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358696b-7465-4111-ad97-b43a4e00e430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:19.003406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358696b-7465-4111-ad97-b43a4e00e430 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:19.003679 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358696b-7465-4111-ad97-b43a4e00e430 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:19.003939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358696b-7465-4111-ad97-b43a4e00e430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:19.007221 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189f0c2-fb6a-48a9-a04a-ac02537d110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:19.007773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f0c2-fb6a-48a9-a04a-ac02537d110f None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:19.008044 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f0c2-fb6a-48a9-a04a-ac02537d110f None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:19.009228 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189f0c2-fb6a-48a9-a04a-ac02537d110f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:19.016241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189f0c2-fb6a-48a9-a04a-ac02537d110f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:19.017727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189f0c2-fb6a-48a9-a04a-ac02537d110f None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-4189f0c2-fb6a-48a9-a04a-ac02537d110f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:06:19.030872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:19.031862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:19.033112 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:06:19.033112 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:06:19.033112 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:06:19.033112 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:06:19.033112 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:06:19.033112 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:06:19.033112 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:19.033112 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:19.033112 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 232/453] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:19.033112 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189f0c2-fb6a-48a9-a04a-ac02537d110f None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:19.038210 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:19.088218 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358696b-7465-4111-ad97-b43a4e00e430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:19.089287 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358696b-7465-4111-ad97-b43a4e00e430 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:19.154101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189f0c2-fb6a-48a9-a04a-ac02537d110f None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:19.190074 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd37fca-d28a-4e5f-9087-2d0557ef1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:19.190708 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37fca-d28a-4e5f-9087-2d0557ef1e5a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:19.190989 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37fca-d28a-4e5f-9087-2d0557ef1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:19.191261 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd37fca-d28a-4e5f-9087-2d0557ef1e5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:19.193072 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 222/454] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:06:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 19:06:19.194048 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358696b-7465-4111-ad97-b43a4e00e430 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:19.203708 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd37fca-d28a-4e5f-9087-2d0557ef1e5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:19.205451 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd37fca-d28a-4e5f-9087-2d0557ef1e5a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-3fd37fca-d28a-4e5f-9087-2d0557ef1e5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:06:19.218101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:19.218969 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:19.219838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:06:19.219838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:06:19.219838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:06:19.219838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:06:19.219838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:06:19.219838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:06:19.219838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:19.219838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:19.221780 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 233/455] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:19.222702 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd37fca-d28a-4e5f-9087-2d0557ef1e5a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:19.228511 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:19.288829 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:19.310318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358696b-7465-4111-ad97-b43a4e00e430 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:19.333198 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd37fca-d28a-4e5f-9087-2d0557ef1e5a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:19.344796 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e4bc-b5a3-45fe-b7a1-a6d38bfd9706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:19.345322 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e4bc-b5a3-45fe-b7a1-a6d38bfd9706 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:19.345596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e4bc-b5a3-45fe-b7a1-a6d38bfd9706 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:19.345863 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845e4bc-b5a3-45fe-b7a1-a6d38bfd9706 None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:19.346545 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845e4bc-b5a3-45fe-b7a1-a6d38bfd9706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:19.346878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845e4bc-b5a3-45fe-b7a1-a6d38bfd9706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:19.348303 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845e4bc-b5a3-45fe-b7a1-a6d38bfd9706 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:19.360304 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 223/456] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:19.360885 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e4bc-b5a3-45fe-b7a1-a6d38bfd9706 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:19.376087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0006f-cd95-42ba-96e8-71fd7225ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:19.376762 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0006f-cd95-42ba-96e8-71fd7225ba1c None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:19.377034 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0006f-cd95-42ba-96e8-71fd7225ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:19.377299 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0006f-cd95-42ba-96e8-71fd7225ba1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:19.390928 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0006f-cd95-42ba-96e8-71fd7225ba1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:19.392378 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0006f-cd95-42ba-96e8-71fd7225ba1c None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-26c0006f-cd95-42ba-96e8-71fd7225ba1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:19.409030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:19.414727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:19.415796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:19.415796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:19.415796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:19.415796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 234/457] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:19.415796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0006f-cd95-42ba-96e8-71fd7225ba1c None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:19.461260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:19.476927 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845e4bc-b5a3-45fe-b7a1-a6d38bfd9706 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:19.513189 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbf6ce-b31d-478e-9097-03b826bc025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:19.513788 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbf6ce-b31d-478e-9097-03b826bc025e None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:19.514062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbf6ce-b31d-478e-9097-03b826bc025e None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:19.514325 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbf6ce-b31d-478e-9097-03b826bc025e None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:19.515001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbf6ce-b31d-478e-9097-03b826bc025e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:19.515296 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbf6ce-b31d-478e-9097-03b826bc025e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:19.516743 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbf6ce-b31d-478e-9097-03b826bc025e None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:19.528368 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 224/458] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:19.528642 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0006f-cd95-42ba-96e8-71fd7225ba1c None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:19.533303 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbf6ce-b31d-478e-9097-03b826bc025e None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:19.551078 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:19.572065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d552db2-5517-49fa-bd29-67db3245b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:19.572769 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d552db2-5517-49fa-bd29-67db3245b830 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:19.573046 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d552db2-5517-49fa-bd29-67db3245b830 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:19.573314 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d552db2-5517-49fa-bd29-67db3245b830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:19.574040 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d552db2-5517-49fa-bd29-67db3245b830 None admin] RBAC: Adding query filter params (role.id=88986c4f59104ec0b79504be9dc10243, scope.project.id=75fce313b5e242adb9eb825bc017e358, user.id=3b28a7b6a48d48f5a23741ad142c93ce) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:19.574347 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d552db2-5517-49fa-bd29-67db3245b830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:19.575773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d552db2-5517-49fa-bd29-67db3245b830 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:19.592492 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 235/459] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:06:19 2022] GET /identity/v3/role_assignments?user.id=3b28a7b6a48d48f5a23741ad142c93ce&scope.project.id=75fce313b5e242adb9eb825bc017e358&role.id=88986c4f59104ec0b79504be9dc10243 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:19.593737 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d552db2-5517-49fa-bd29-67db3245b830 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:19.653829 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbf6ce-b31d-478e-9097-03b826bc025e None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:19.699139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391c3d4-d820-4a4a-940d-79aa6c9f7df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:19.699907 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391c3d4-d820-4a4a-940d-79aa6c9f7df1 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:19.700188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391c3d4-d820-4a4a-940d-79aa6c9f7df1 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:19.700550 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391c3d4-d820-4a4a-940d-79aa6c9f7df1 None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:19.701249 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391c3d4-d820-4a4a-940d-79aa6c9f7df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:19.701714 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391c3d4-d820-4a4a-940d-79aa6c9f7df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:19.708313 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391c3d4-d820-4a4a-940d-79aa6c9f7df1 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:19.717178 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 225/460] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:19.722411 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391c3d4-d820-4a4a-940d-79aa6c9f7df1 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:19.735108 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:19.746961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d552db2-5517-49fa-bd29-67db3245b830 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:19.797065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294821-f39e-440c-9f1a-dfe95fcd2c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:19.797676 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294821-f39e-440c-9f1a-dfe95fcd2c7f None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:19.797951 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294821-f39e-440c-9f1a-dfe95fcd2c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:19.798272 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294821-f39e-440c-9f1a-dfe95fcd2c7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:19.798994 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0294821-f39e-440c-9f1a-dfe95fcd2c7f None admin] RBAC: Adding query filter params (role.id=88986c4f59104ec0b79504be9dc10243, scope.project.id=75fce313b5e242adb9eb825bc017e358, user.id=b3e19f1878d042b295d1f75a3a781419) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:19.799348 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0294821-f39e-440c-9f1a-dfe95fcd2c7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:19.801684 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0294821-f39e-440c-9f1a-dfe95fcd2c7f None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:19.810370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 236/461] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:06:19 2022] GET /identity/v3/role_assignments?user.id=b3e19f1878d042b295d1f75a3a781419&scope.project.id=75fce313b5e242adb9eb825bc017e358&role.id=88986c4f59104ec0b79504be9dc10243 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:19.868126 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391c3d4-d820-4a4a-940d-79aa6c9f7df1 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:19.907562 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0cf5b-b79d-4dd6-894b-72ed36722162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:19.908143 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0cf5b-b79d-4dd6-894b-72ed36722162 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:19.908440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0cf5b-b79d-4dd6-894b-72ed36722162 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:19.908712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0cf5b-b79d-4dd6-894b-72ed36722162 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:19.916965 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0cf5b-b79d-4dd6-894b-72ed36722162 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:19.918500 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0cf5b-b79d-4dd6-894b-72ed36722162 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-d6c0cf5b-b79d-4dd6-894b-72ed36722162 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:06:19.932373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:19.933272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:19.934102 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:06:19.934102 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:06:19.934102 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:06:19.934102 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:06:19.934102 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:06:19.934102 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:06:19.934102 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:19.934102 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:19.934102 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 226/462] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:06:19.941531 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294821-f39e-440c-9f1a-dfe95fcd2c7f None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:19.998853 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:20.060698 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294821-f39e-440c-9f1a-dfe95fcd2c7f None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:20.096789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d904a-1b6e-408f-b3c9-5df5e1f8da17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:20.097758 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d904a-1b6e-408f-b3c9-5df5e1f8da17 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:20.098227 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d904a-1b6e-408f-b3c9-5df5e1f8da17 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:20.098683 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d904a-1b6e-408f-b3c9-5df5e1f8da17 None admin] PATH_INFO: `/v3/projects` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:20.099550 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d904a-1b6e-408f-b3c9-5df5e1f8da17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:20.100086 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d904a-1b6e-408f-b3c9-5df5e1f8da17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:20.101774 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d904a-1b6e-408f-b3c9-5df5e1f8da17 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:20.114802 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 237/463] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:20.121464 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0cf5b-b79d-4dd6-894b-72ed36722162 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:20.195121 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:20.232849 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0cf5b-b79d-4dd6-894b-72ed36722162 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:20.273937 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d6a4b-1bbb-4373-b683-3a3e08fdd167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:20.274903 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d6a4b-1bbb-4373-b683-3a3e08fdd167 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:20.275387 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d6a4b-1bbb-4373-b683-3a3e08fdd167 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:20.275848 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d6a4b-1bbb-4373-b683-3a3e08fdd167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:20.276845 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d6a4b-1bbb-4373-b683-3a3e08fdd167 None admin] RBAC: Adding query filter params (role.id=88986c4f59104ec0b79504be9dc10243, scope.project.id=75fce313b5e242adb9eb825bc017e358, user.id=09fce752a3264bb19af1260da2b83315) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:20.277380 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d6a4b-1bbb-4373-b683-3a3e08fdd167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:20.279017 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d6a4b-1bbb-4373-b683-3a3e08fdd167 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:20.285686 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 227/464] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:06:20 2022] GET /identity/v3/role_assignments?user.id=09fce752a3264bb19af1260da2b83315&scope.project.id=75fce313b5e242adb9eb825bc017e358&role.id=88986c4f59104ec0b79504be9dc10243 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:21.313750 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237c33b-ac78-4ce4-b7dd-31fee46411db None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:21.314269 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237c33b-ac78-4ce4-b7dd-31fee46411db None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:21.314269 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237c33b-ac78-4ce4-b7dd-31fee46411db None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:21.315754 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 238/465] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:21.321681 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208485-82a9-4ec3-8dcc-9f7b889e07e2 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:21.322080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208485-82a9-4ec3-8dcc-9f7b889e07e2 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:21.322246 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208485-82a9-4ec3-8dcc-9f7b889e07e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:21.340750 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-9e208485-82a9-4ec3-8dcc-9f7b889e07e2 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:21.341908 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-9e208485-82a9-4ec3-8dcc-9f7b889e07e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:21.411389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 228/466] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:21.743185 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237c33b-ac78-4ce4-b7dd-31fee46411db None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:21.859374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237c33b-ac78-4ce4-b7dd-31fee46411db None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:21.861764 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:21.898267 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fc3ab-28a1-4f1a-830f-d37072dbace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:21.898893 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fc3ab-28a1-4f1a-830f-d37072dbace7 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:21.899170 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fc3ab-28a1-4f1a-830f-d37072dbace7 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:21.899443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fc3ab-28a1-4f1a-830f-d37072dbace7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:21.910755 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fc3ab-28a1-4f1a-830f-d37072dbace7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-4d8fc3ab-28a1-4f1a-830f-d37072dbace7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:21.916738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:21.917726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:21.918562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 239/467] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 19:06:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:21.925393 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e208485-82a9-4ec3-8dcc-9f7b889e07e2 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:21.988914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:22.038151 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e208485-82a9-4ec3-8dcc-9f7b889e07e2 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:22.073887 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a54cfa-fc94-4a4b-b41d-c230b5803bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:22.074777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a54cfa-fc94-4a4b-b41d-c230b5803bf6 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.075222 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a54cfa-fc94-4a4b-b41d-c230b5803bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.075690 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a54cfa-fc94-4a4b-b41d-c230b5803bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.076538 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a54cfa-fc94-4a4b-b41d-c230b5803bf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:22.077005 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a54cfa-fc94-4a4b-b41d-c230b5803bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:22.078516 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a54cfa-fc94-4a4b-b41d-c230b5803bf6 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:22.087478 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 229/468] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:06:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:22.093096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fc3ab-28a1-4f1a-830f-d37072dbace7 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:22.204806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fc3ab-28a1-4f1a-830f-d37072dbace7 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:22.225776 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582002f-392b-40e5-8558-2fe08e1f21e2 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.226051 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582002f-392b-40e5-8558-2fe08e1f21e2 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.226323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582002f-392b-40e5-8558-2fe08e1f21e2 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.228026 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 230/469] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:06:22.233115 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e8499-c68b-4907-8a01-4f39a8c5e36f None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.233397 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e8499-c68b-4907-8a01-4f39a8c5e36f None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.233669 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e8499-c68b-4907-8a01-4f39a8c5e36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.245251 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027da45-6c14-4e06-bd94-bc1a2dc417c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:22.246150 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027da45-6c14-4e06-bd94-bc1a2dc417c2 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.246597 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027da45-6c14-4e06-bd94-bc1a2dc417c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.247033 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027da45-6c14-4e06-bd94-bc1a2dc417c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.253950 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-5e4e8499-c68b-4907-8a01-4f39a8c5e36f None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:22.255531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-5e4e8499-c68b-4907-8a01-4f39a8c5e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:22.259378 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027da45-6c14-4e06-bd94-bc1a2dc417c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:22.261184 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027da45-6c14-4e06-bd94-bc1a2dc417c2 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-8027da45-6c14-4e06-bd94-bc1a2dc417c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:22.278484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:22.279425 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:22.280299 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:22.280299 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:22.280299 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:22.282276 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 240/470] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:22.287920 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027da45-6c14-4e06-bd94-bc1a2dc417c2 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:22.308319 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:22.348318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 231/471] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 19:06:22.380057 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ef60-1650-45e8-ab89-aaca9719f850 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.380398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ef60-1650-45e8-ab89-aaca9719f850 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.380646 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4ef60-1650-45e8-ab89-aaca9719f850 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.386574 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 232/472] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:06:22.388190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28438118-be16-4ced-91b9-73112a407110 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.388518 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28438118-be16-4ced-91b9-73112a407110 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.388789 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28438118-be16-4ced-91b9-73112a407110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.407284 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-28438118-be16-4ced-91b9-73112a407110 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:22.408781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-28438118-be16-4ced-91b9-73112a407110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:22.409827 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027da45-6c14-4e06-bd94-bc1a2dc417c2 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:22.444980 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73117e6f-5b72-48d2-93fe-5b5af98e43b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:22.445583 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73117e6f-5b72-48d2-93fe-5b5af98e43b1 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.445857 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73117e6f-5b72-48d2-93fe-5b5af98e43b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.446123 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73117e6f-5b72-48d2-93fe-5b5af98e43b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.446757 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73117e6f-5b72-48d2-93fe-5b5af98e43b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:22.447060 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73117e6f-5b72-48d2-93fe-5b5af98e43b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:22.449050 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73117e6f-5b72-48d2-93fe-5b5af98e43b1 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:22.461960 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:22.465715 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 241/473] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:22.466630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73117e6f-5b72-48d2-93fe-5b5af98e43b1 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:22.485936 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 233/474] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:22.544825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:22.569005 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73117e6f-5b72-48d2-93fe-5b5af98e43b1 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:22.603437 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797a97c-3b3c-46c0-adb4-bbd0edea7d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:22.604054 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a97c-3b3c-46c0-adb4-bbd0edea7d9c None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.604361 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a97c-3b3c-46c0-adb4-bbd0edea7d9c None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.604628 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797a97c-3b3c-46c0-adb4-bbd0edea7d9c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.611766 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797a97c-3b3c-46c0-adb4-bbd0edea7d9c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:22.613211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797a97c-3b3c-46c0-adb4-bbd0edea7d9c None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-4797a97c-3b3c-46c0-adb4-bbd0edea7d9c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:06:22.624889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:22.625801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:22.626701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:22.626701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:22.626701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:06:22.626701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:06:22.626701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:06:22.626701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:06:22.626701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:06:22.626701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:06:22.626701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 19:06:22.626701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:22.626701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 242/475] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Oct 20 19:06:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:06:22.632530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28438118-be16-4ced-91b9-73112a407110 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:22.687741 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797a97c-3b3c-46c0-adb4-bbd0edea7d9c None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:22.761394 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28438118-be16-4ced-91b9-73112a407110 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:22.795990 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797a97c-3b3c-46c0-adb4-bbd0edea7d9c None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:22.797378 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ebed2-a25a-4b23-9759-a76f2742feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:22.797966 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebed2-a25a-4b23-9759-a76f2742feca None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.798232 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebed2-a25a-4b23-9759-a76f2742feca None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.799104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebed2-a25a-4b23-9759-a76f2742feca None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.799209 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ebed2-a25a-4b23-9759-a76f2742feca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:22.799495 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ebed2-a25a-4b23-9759-a76f2742feca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:22.800944 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ebed2-a25a-4b23-9759-a76f2742feca None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:22.819231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 234/476] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Oct 20 19:06:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:22.820538 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4679a-ca64-46cd-8641-b16180709e0b None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.820823 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4679a-ca64-46cd-8641-b16180709e0b None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.821092 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4679a-ca64-46cd-8641-b16180709e0b None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.824306 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 235/477] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:22.824306 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4679a-ca64-46cd-8641-b16180709e0b None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:22.835526 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0764-d07c-4f57-9d1a-780a6de0da29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:22.836153 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0764-d07c-4f57-9d1a-780a6de0da29 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.836460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0764-d07c-4f57-9d1a-780a6de0da29 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.836731 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0764-d07c-4f57-9d1a-780a6de0da29 None admin] PATH_INFO: `/v3/services/image` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.837308 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0764-d07c-4f57-9d1a-780a6de0da29 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:22.838666 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0764-d07c-4f57-9d1a-780a6de0da29 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:22.842267 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-34ed0764-d07c-4f57-9d1a-780a6de0da29 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:22.851232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:22.852183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:22.853017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 243/478] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Oct 20 19:06:22 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:22.853772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0764-d07c-4f57-9d1a-780a6de0da29 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:22.869890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:22.926706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4679a-ca64-46cd-8641-b16180709e0b None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:22.955340 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0764-d07c-4f57-9d1a-780a6de0da29 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:22.960215 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592888b-0b72-4961-97ac-7f428c3697ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:22.960865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592888b-0b72-4961-97ac-7f428c3697ad None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.961141 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592888b-0b72-4961-97ac-7f428c3697ad None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.961409 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592888b-0b72-4961-97ac-7f428c3697ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.961984 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592888b-0b72-4961-97ac-7f428c3697ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:22.963345 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592888b-0b72-4961-97ac-7f428c3697ad None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-d592888b-0b72-4961-97ac-7f428c3697ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:22.973769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:22.974754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:22.975581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 236/479] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Oct 20 19:06:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:22.976382 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e3812-a53f-4e34-8659-269fde8122be None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.976382 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e3812-a53f-4e34-8659-269fde8122be None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.976644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e3812-a53f-4e34-8659-269fde8122be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.991441 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3549-e28a-4273-ba23-79ad0154c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:22.992055 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3549-e28a-4273-ba23-79ad0154c826 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:22.992367 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3549-e28a-4273-ba23-79ad0154c826 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:22.992633 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3549-e28a-4273-ba23-79ad0154c826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:22.994640 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-a02e3812-a53f-4e34-8659-269fde8122be None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:22.995812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-a02e3812-a53f-4e34-8659-269fde8122be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:23.002567 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec3549-e28a-4273-ba23-79ad0154c826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:23.004023 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec3549-e28a-4273-ba23-79ad0154c826 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-18ec3549-e28a-4273-ba23-79ad0154c826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:23.019264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:23.025558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:23.026579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:23.026579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:23.026579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:23.026579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 244/480] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:23.026579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3549-e28a-4273-ba23-79ad0154c826 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:23.066506 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 237/481] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:23.067263 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e3812-a53f-4e34-8659-269fde8122be None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:23.081259 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:23.102402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:23.128241 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3549-e28a-4273-ba23-79ad0154c826 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:23.163988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0bfba-f72b-4a00-a55f-060673518055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:23.164763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0bfba-f72b-4a00-a55f-060673518055 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:23.165136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0bfba-f72b-4a00-a55f-060673518055 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:23.165491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0bfba-f72b-4a00-a55f-060673518055 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:23.166193 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0bfba-f72b-4a00-a55f-060673518055 None admin] RBAC: Adding query filter params (name=image) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:23.166861 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0bfba-f72b-4a00-a55f-060673518055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:23.168339 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0bfba-f72b-4a00-a55f-060673518055 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:23.172300 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e3812-a53f-4e34-8659-269fde8122be None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:23.178497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 245/482] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:23.179246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0bfba-f72b-4a00-a55f-060673518055 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:23.208138 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b92325-8ea4-4b1d-b18e-9b23e8814caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:23.208781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92325-8ea4-4b1d-b18e-9b23e8814caa None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:23.209615 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92325-8ea4-4b1d-b18e-9b23e8814caa None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:23.209945 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b92325-8ea4-4b1d-b18e-9b23e8814caa None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:23.210557 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b92325-8ea4-4b1d-b18e-9b23e8814caa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:23.210855 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b92325-8ea4-4b1d-b18e-9b23e8814caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:23.212209 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b92325-8ea4-4b1d-b18e-9b23e8814caa None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:23.216538 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 238/483] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 19:06:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:23.216538 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b92325-8ea4-4b1d-b18e-9b23e8814caa None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:23.286625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0bfba-f72b-4a00-a55f-060673518055 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:23.305165 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:23.316361 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:23.322013 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b92325-8ea4-4b1d-b18e-9b23e8814caa None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:23.324120 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3af67-067d-4f35-9337-990e61c64d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:23.324764 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3af67-067d-4f35-9337-990e61c64d81 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:23.325045 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3af67-067d-4f35-9337-990e61c64d81 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:23.325344 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3af67-067d-4f35-9337-990e61c64d81 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:23.325983 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3af67-067d-4f35-9337-990e61c64d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:23.326282 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3af67-067d-4f35-9337-990e61c64d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:23.327630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3af67-067d-4f35-9337-990e61c64d81 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:23.340146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 246/484] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:23.341086 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3af67-067d-4f35-9337-990e61c64d81 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:23.365906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ab9f4-931c-4f79-a57f-a4fca9fa4466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:23.367118 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab9f4-931c-4f79-a57f-a4fca9fa4466 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:23.367529 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab9f4-931c-4f79-a57f-a4fca9fa4466 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:23.367941 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab9f4-931c-4f79-a57f-a4fca9fa4466 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:23.368727 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ab9f4-931c-4f79-a57f-a4fca9fa4466 None admin] RBAC: Adding query filter params (type=image) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:23.369175 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ab9f4-931c-4f79-a57f-a4fca9fa4466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:23.370693 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ab9f4-931c-4f79-a57f-a4fca9fa4466 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:23.376991 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 239/485] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:23.377975 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ab9f4-931c-4f79-a57f-a4fca9fa4466 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:23.460043 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3af67-067d-4f35-9337-990e61c64d81 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:23.500753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ab9f4-931c-4f79-a57f-a4fca9fa4466 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:23.501688 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e52551-79f2-4fdf-b9a2-45c5017561d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:23.502398 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e52551-79f2-4fdf-b9a2-45c5017561d7 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:23.502777 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e52551-79f2-4fdf-b9a2-45c5017561d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:23.503897 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e52551-79f2-4fdf-b9a2-45c5017561d7 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:23.503897 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e52551-79f2-4fdf-b9a2-45c5017561d7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:23.504188 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e52551-79f2-4fdf-b9a2-45c5017561d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:23.505734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e52551-79f2-4fdf-b9a2-45c5017561d7 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:23.520314 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 247/486] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 19:06:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:23.520314 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e52551-79f2-4fdf-b9a2-45c5017561d7 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:23.552468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0464015-5dbb-402b-bf7a-78a05d1173a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:23.554323 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0464015-5dbb-402b-bf7a-78a05d1173a6 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:23.554993 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0464015-5dbb-402b-bf7a-78a05d1173a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:23.555349 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0464015-5dbb-402b-bf7a-78a05d1173a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:23.566485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0464015-5dbb-402b-bf7a-78a05d1173a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:23.568113 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0464015-5dbb-402b-bf7a-78a05d1173a6 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:23.576885 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-a0464015-5dbb-402b-bf7a-78a05d1173a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:06:23.584954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:23.586071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:23.587124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:06:23.587124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:06:23.587124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:06:23.587124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:06:23.587124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:06:23.587124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:06:23.587124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:23.587124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:23.591061 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 240/487] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:23.594701 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0464015-5dbb-402b-bf7a-78a05d1173a6 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:23.635094 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:23.666037 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e52551-79f2-4fdf-b9a2-45c5017561d7 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:23.718555 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21deb0e-2cb3-4a9a-bf1a-401d878216aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:23.720178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21deb0e-2cb3-4a9a-bf1a-401d878216aa None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:23.720823 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21deb0e-2cb3-4a9a-bf1a-401d878216aa None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:23.721292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21deb0e-2cb3-4a9a-bf1a-401d878216aa None admin] PATH_INFO: `/v3/services/network` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:23.721864 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0464015-5dbb-402b-bf7a-78a05d1173a6 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:23.722315 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21deb0e-2cb3-4a9a-bf1a-401d878216aa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:23.724135 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21deb0e-2cb3-4a9a-bf1a-401d878216aa None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-f21deb0e-2cb3-4a9a-bf1a-401d878216aa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:23.734030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:23.735246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 19:06:23.736232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:23.738723 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 248/488] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:23 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:23.749385 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21deb0e-2cb3-4a9a-bf1a-401d878216aa None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:23.769818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee12e43-702a-48a0-aff9-53c449a41f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:23.770567 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee12e43-702a-48a0-aff9-53c449a41f90 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:23.770945 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee12e43-702a-48a0-aff9-53c449a41f90 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:23.771829 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee12e43-702a-48a0-aff9-53c449a41f90 None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:23.772933 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee12e43-702a-48a0-aff9-53c449a41f90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:23.774805 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee12e43-702a-48a0-aff9-53c449a41f90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:23.777570 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee12e43-702a-48a0-aff9-53c449a41f90 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:23.793542 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 241/489] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:06:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:23.794925 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee12e43-702a-48a0-aff9-53c449a41f90 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:23.873992 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21deb0e-2cb3-4a9a-bf1a-401d878216aa None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:23.877216 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:23.887718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:23.907024 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee12e43-702a-48a0-aff9-53c449a41f90 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:23.926215 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a52a8-438f-4e5a-b4bf-fad444c74b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:23.927184 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a52a8-438f-4e5a-b4bf-fad444c74b07 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:23.928355 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a52a8-438f-4e5a-b4bf-fad444c74b07 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:23.929427 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a52a8-438f-4e5a-b4bf-fad444c74b07 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:23.930567 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a52a8-438f-4e5a-b4bf-fad444c74b07 None admin] RBAC: Adding query filter params (name=network) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:23.931092 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a52a8-438f-4e5a-b4bf-fad444c74b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:23.933522 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a52a8-438f-4e5a-b4bf-fad444c74b07 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:23.940246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 249/490] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:23.944990 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbf8b1-7b48-423a-9a36-f0eeb1635e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:23.945769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf8b1-7b48-423a-9a36-f0eeb1635e2d None admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:23.946144 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf8b1-7b48-423a-9a36-f0eeb1635e2d None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:23.946448 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a52a8-438f-4e5a-b4bf-fad444c74b07 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:23.946580 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf8b1-7b48-423a-9a36-f0eeb1635e2d None admin] PATH_INFO: `/v3/projects/75fce313b5e242adb9eb825bc017e358/users/cc6df159e6dc419cae222ebc3e5c99f4/roles/fde247f30afe4b81958b67c776cabec0` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:23.948753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbf8b1-7b48-423a-9a36-f0eeb1635e2d None admin] RBAC: Authorizing `identity:create_grant(project_id=75fce313b5e242adb9eb825bc017e358, user_id=cc6df159e6dc419cae222ebc3e5c99f4, role_id=fde247f30afe4b81958b67c776cabec0)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:23.950628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbf8b1-7b48-423a-9a36-f0eeb1635e2d None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:23.967030 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 242/491] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:06:23 2022] PUT /identity/v3/projects/75fce313b5e242adb9eb825bc017e358/users/cc6df159e6dc419cae222ebc3e5c99f4/roles/fde247f30afe4b81958b67c776cabec0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 19:06:24.068938 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a52a8-438f-4e5a-b4bf-fad444c74b07 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:24.110236 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d851301-6ff3-43c0-819c-90b6a33fb44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:24.110864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d851301-6ff3-43c0-819c-90b6a33fb44a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:24.111141 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d851301-6ff3-43c0-819c-90b6a33fb44a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:24.111412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d851301-6ff3-43c0-819c-90b6a33fb44a None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:24.112057 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d851301-6ff3-43c0-819c-90b6a33fb44a None admin] RBAC: Adding query filter params (type=network) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:24.112393 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d851301-6ff3-43c0-819c-90b6a33fb44a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:24.113778 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d851301-6ff3-43c0-819c-90b6a33fb44a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:24.119815 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 250/492] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:25.864775 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0286ca5-dc36-4761-b700-1ea8f6aedc0c None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:25.866118 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0286ca5-dc36-4761-b700-1ea8f6aedc0c None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:25.866118 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0286ca5-dc36-4761-b700-1ea8f6aedc0c None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:25.867513 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 243/493] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:25.872687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07c97b-955d-4ae1-bd48-2337290a4b3e None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:25.873105 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07c97b-955d-4ae1-bd48-2337290a4b3e None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:25.873261 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07c97b-955d-4ae1-bd48-2337290a4b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:25.891630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-2c07c97b-955d-4ae1-bd48-2337290a4b3e None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:25.892846 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-2c07c97b-955d-4ae1-bd48-2337290a4b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:25.924004 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:25.967737 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 251/494] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:26.062248 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0313b-8167-49f0-9407-649668c885e4 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:26.062685 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0313b-8167-49f0-9407-649668c885e4 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:26.063055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0313b-8167-49f0-9407-649668c885e4 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:26.064786 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 244/495] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:26.071120 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34b2cc-9973-4011-b734-582754f96e19 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:26.071554 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34b2cc-9973-4011-b734-582754f96e19 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:26.071927 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34b2cc-9973-4011-b734-582754f96e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:26.091050 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-db34b2cc-9973-4011-b734-582754f96e19 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:26.092239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-db34b2cc-9973-4011-b734-582754f96e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:26.162415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 252/496] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:26.292347 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0313b-8167-49f0-9407-649668c885e4 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:26.405209 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0313b-8167-49f0-9407-649668c885e4 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:26.441905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad079f-ec33-450d-bb9e-a1c3343e706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:26.442507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad079f-ec33-450d-bb9e-a1c3343e706f None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:26.442786 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad079f-ec33-450d-bb9e-a1c3343e706f None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:26.443612 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad079f-ec33-450d-bb9e-a1c3343e706f None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:26.444479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad079f-ec33-450d-bb9e-a1c3343e706f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:26.445922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad079f-ec33-450d-bb9e-a1c3343e706f None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:26.467412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 245/497] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 19:06:26 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:26.480595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08377f73-2e2a-402b-a0e3-ee5971df4c1c None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:26.481201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08377f73-2e2a-402b-a0e3-ee5971df4c1c None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:26.481678 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08377f73-2e2a-402b-a0e3-ee5971df4c1c None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:26.484848 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 253/498] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:26.489953 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad52113-19d6-4ca2-a253-1a6a45380f74 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:26.490536 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad52113-19d6-4ca2-a253-1a6a45380f74 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:26.490975 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad52113-19d6-4ca2-a253-1a6a45380f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:26.498097 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:26.499694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08377f73-2e2a-402b-a0e3-ee5971df4c1c None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:26.521395 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-1ad52113-19d6-4ca2-a253-1a6a45380f74 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:26.523101 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-1ad52113-19d6-4ca2-a253-1a6a45380f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:26.614347 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 246/499] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:26 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:26.615880 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:26.636740 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08377f73-2e2a-402b-a0e3-ee5971df4c1c None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:26.658722 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722b35-7b20-4a21-a682-3b111163a2a7 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:26.659061 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722b35-7b20-4a21-a682-3b111163a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:26.659262 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86722b35-7b20-4a21-a682-3b111163a2a7 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:26.660667 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 247/500] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:06:26.667147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309684c-666f-4a3c-a256-bb85f406e52e None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:26.667467 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309684c-666f-4a3c-a256-bb85f406e52e None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:26.667718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309684c-666f-4a3c-a256-bb85f406e52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:26.684616 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0915e1-8225-41e9-96ac-0a0c4852d40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:26.685598 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0915e1-8225-41e9-96ac-0a0c4852d40a None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:26.686093 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0915e1-8225-41e9-96ac-0a0c4852d40a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:26.686562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0915e1-8225-41e9-96ac-0a0c4852d40a None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:26.687474 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0915e1-8225-41e9-96ac-0a0c4852d40a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:26.687588 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-8309684c-666f-4a3c-a256-bb85f406e52e None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:26.689260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-8309684c-666f-4a3c-a256-bb85f406e52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:26.689498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0915e1-8225-41e9-96ac-0a0c4852d40a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:26.710749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 254/501] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 19:06:26 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 19:06:26.778456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 248/502] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:26 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 19:06:26.959528 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0915e1-8225-41e9-96ac-0a0c4852d40a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:27.063335 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0915e1-8225-41e9-96ac-0a0c4852d40a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:27.097751 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aefb9-9a65-41cd-b031-826df7d363e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:27.098766 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aefb9-9a65-41cd-b031-826df7d363e8 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:27.099760 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aefb9-9a65-41cd-b031-826df7d363e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:27.100233 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aefb9-9a65-41cd-b031-826df7d363e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:27.104976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309684c-666f-4a3c-a256-bb85f406e52e None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:27.113179 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6aefb9-9a65-41cd-b031-826df7d363e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-3b6aefb9-9a65-41cd-b031-826df7d363e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:06:27.119167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:27.120146 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:06:27.121961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:27.122598 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 255/503] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 19:06:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:27.130443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aefb9-9a65-41cd-b031-826df7d363e8 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:27.148646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:27.177110 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:27.226055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309684c-666f-4a3c-a256-bb85f406e52e None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:27.260617 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aefb9-9a65-41cd-b031-826df7d363e8 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:27.264134 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe7f5d-b74d-4c39-85a7-71270aacbd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:27.264886 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe7f5d-b74d-4c39-85a7-71270aacbd84 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:27.265222 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe7f5d-b74d-4c39-85a7-71270aacbd84 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:27.265554 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe7f5d-b74d-4c39-85a7-71270aacbd84 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:27.266272 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe7f5d-b74d-4c39-85a7-71270aacbd84 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:27.267697 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe7f5d-b74d-4c39-85a7-71270aacbd84 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:27.285350 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 249/504] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 19:06:27 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:27.325851 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a151d-fb56-480f-9a9b-6ec68b0f30ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:27.326578 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a151d-fb56-480f-9a9b-6ec68b0f30ae None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:27.326861 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a151d-fb56-480f-9a9b-6ec68b0f30ae None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:27.327132 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a151d-fb56-480f-9a9b-6ec68b0f30ae None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:27.327916 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a151d-fb56-480f-9a9b-6ec68b0f30ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:27.328226 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a151d-fb56-480f-9a9b-6ec68b0f30ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:27.329799 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a151d-fb56-480f-9a9b-6ec68b0f30ae None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:27.340712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 256/505] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:06:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:27.346777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe7f5d-b74d-4c39-85a7-71270aacbd84 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:27.464942 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe7f5d-b74d-4c39-85a7-71270aacbd84 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:27.485835 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:27.514330 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6308e3-eea3-4323-881e-bc74649ee10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:27.514968 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6308e3-eea3-4323-881e-bc74649ee10a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:27.515245 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6308e3-eea3-4323-881e-bc74649ee10a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:27.515493 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6308e3-eea3-4323-881e-bc74649ee10a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:27.528258 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6308e3-eea3-4323-881e-bc74649ee10a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:27.529735 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6308e3-eea3-4323-881e-bc74649ee10a None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-2b6308e3-eea3-4323-881e-bc74649ee10a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:27.550983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:27.554147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:27.556146 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:27.556146 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:27.556146 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:27.556146 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 250/506] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:27.558721 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a151d-fb56-480f-9a9b-6ec68b0f30ae None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:27.632675 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:27.664836 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a151d-fb56-480f-9a9b-6ec68b0f30ae None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:27.714038 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9dbb1-5666-4084-a105-6b06d7721e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:27.714647 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9dbb1-5666-4084-a105-6b06d7721e81 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:27.714920 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9dbb1-5666-4084-a105-6b06d7721e81 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:27.715187 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9dbb1-5666-4084-a105-6b06d7721e81 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:27.715819 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9dbb1-5666-4084-a105-6b06d7721e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:27.716115 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9dbb1-5666-4084-a105-6b06d7721e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:27.717520 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9dbb1-5666-4084-a105-6b06d7721e81 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:27.730104 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 257/507] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:27.735607 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6308e3-eea3-4323-881e-bc74649ee10a None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:27.842634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6308e3-eea3-4323-881e-bc74649ee10a None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:27.877650 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d0eda-b811-489f-b03c-b65830fc1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:27.878279 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d0eda-b811-489f-b03c-b65830fc1dd4 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:27.878553 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d0eda-b811-489f-b03c-b65830fc1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:27.878820 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d0eda-b811-489f-b03c-b65830fc1dd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:27.887512 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d0eda-b811-489f-b03c-b65830fc1dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:27.888983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d0eda-b811-489f-b03c-b65830fc1dd4 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-e46d0eda-b811-489f-b03c-b65830fc1dd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:06:27.900699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:27.901800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:27.902706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:27.902706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:27.902706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:06:27.902706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:06:27.902706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:06:27.902706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:06:27.902706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:06:27.902706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:06:27.902706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 19:06:27.902706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:27.902706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 251/508] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Oct 20 19:06:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:27.909398 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9dbb1-5666-4084-a105-6b06d7721e81 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:28.016294 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9dbb1-5666-4084-a105-6b06d7721e81 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:28.046668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:28.053441 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f987000-dd8a-4011-9c98-e23d245f2e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:28.053951 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f987000-dd8a-4011-9c98-e23d245f2e8d None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:28.054240 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f987000-dd8a-4011-9c98-e23d245f2e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:28.054516 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f987000-dd8a-4011-9c98-e23d245f2e8d None admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:28.055479 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f987000-dd8a-4011-9c98-e23d245f2e8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:28.055721 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f987000-dd8a-4011-9c98-e23d245f2e8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:28.057192 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f987000-dd8a-4011-9c98-e23d245f2e8d None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:28.075598 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 258/509] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Oct 20 19:06:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:28.081187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d0eda-b811-489f-b03c-b65830fc1dd4 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:28.110809 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:28.187082 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d0eda-b811-489f-b03c-b65830fc1dd4 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:28.222044 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f0b14-bbea-41d7-83f8-98ddab50896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:28.222640 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f0b14-bbea-41d7-83f8-98ddab50896d None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:28.222913 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f0b14-bbea-41d7-83f8-98ddab50896d None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:28.223175 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f0b14-bbea-41d7-83f8-98ddab50896d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:28.291868 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f0b14-bbea-41d7-83f8-98ddab50896d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:28.293424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f0b14-bbea-41d7-83f8-98ddab50896d None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:28.319415 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:28.393069 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 252/510] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:06:28 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 19:06:28.399006 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f987000-dd8a-4011-9c98-e23d245f2e8d None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:28.504634 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f987000-dd8a-4011-9c98-e23d245f2e8d None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:28.540695 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262835d-5fac-49af-994f-d9f064af6989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:28.541674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262835d-5fac-49af-994f-d9f064af6989 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:28.541945 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262835d-5fac-49af-994f-d9f064af6989 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:28.542215 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262835d-5fac-49af-994f-d9f064af6989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:28.553320 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262835d-5fac-49af-994f-d9f064af6989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:28.554881 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262835d-5fac-49af-994f-d9f064af6989 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-0262835d-5fac-49af-994f-d9f064af6989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:28.570277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:28.572497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:28.574523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:28.574523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:28.574523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:28.574523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 259/511] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:28.577551 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f0b14-bbea-41d7-83f8-98ddab50896d None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:28.686731 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f0b14-bbea-41d7-83f8-98ddab50896d None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:28.715865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:28.725425 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40256ea0-c652-4ee0-803a-4312c847025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:28.726038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40256ea0-c652-4ee0-803a-4312c847025a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:28.726307 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40256ea0-c652-4ee0-803a-4312c847025a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:28.726573 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40256ea0-c652-4ee0-803a-4312c847025a None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:28.727213 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40256ea0-c652-4ee0-803a-4312c847025a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:28.727571 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40256ea0-c652-4ee0-803a-4312c847025a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:28.728997 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40256ea0-c652-4ee0-803a-4312c847025a None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:28.743182 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 253/512] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:28.750089 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262835d-5fac-49af-994f-d9f064af6989 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:28.817441 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:28.859434 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262835d-5fac-49af-994f-d9f064af6989 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:28.894316 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4931a3-eadf-4621-93f5-122d64fb7bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:28.894939 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4931a3-eadf-4621-93f5-122d64fb7bce None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:28.895213 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4931a3-eadf-4621-93f5-122d64fb7bce None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:28.895482 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4931a3-eadf-4621-93f5-122d64fb7bce None admin] PATH_INFO: `/v3/projects/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:28.903043 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4931a3-eadf-4621-93f5-122d64fb7bce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:28.904504 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4931a3-eadf-4621-93f5-122d64fb7bce None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-de4931a3-eadf-4621-93f5-122d64fb7bce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:06:28.917888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:28.918783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:28.919680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:06:28.919680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:06:28.919680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:06:28.919680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:06:28.919680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:06:28.919680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:06:28.919680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:28.919680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:28.919680 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 260/513] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:28.924942 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40256ea0-c652-4ee0-803a-4312c847025a None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:29.027096 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40256ea0-c652-4ee0-803a-4312c847025a None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:29.062075 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb722d68-823d-49da-abc0-aa833d00745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:29.062673 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722d68-823d-49da-abc0-aa833d00745b None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:29.062946 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722d68-823d-49da-abc0-aa833d00745b None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:29.063210 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb722d68-823d-49da-abc0-aa833d00745b None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:29.063889 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb722d68-823d-49da-abc0-aa833d00745b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:29.064186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb722d68-823d-49da-abc0-aa833d00745b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:29.065625 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb722d68-823d-49da-abc0-aa833d00745b None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:29.078037 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 254/514] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:29.083968 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4931a3-eadf-4621-93f5-122d64fb7bce None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:29.123107 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb005-c9e4-4c51-b874-86eca0d0bd07 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:29.123749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb005-c9e4-4c51-b874-86eca0d0bd07 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:29.123749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb005-c9e4-4c51-b874-86eca0d0bd07 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:29.125421 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 255/515] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:29.130588 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eba24-4e52-4cb6-a962-e240d771b00a None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:29.130978 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eba24-4e52-4cb6-a962-e240d771b00a None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:29.131447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eba24-4e52-4cb6-a962-e240d771b00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:29.150806 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-841eba24-4e52-4cb6-a962-e240d771b00a None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:29.152049 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-841eba24-4e52-4cb6-a962-e240d771b00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:29.201042 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:29.204498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4931a3-eadf-4621-93f5-122d64fb7bce None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:29.206013 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:29.232803 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 256/516] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:29 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 19:06:29.234399 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e3fba-e244-4feb-a4c7-fb27d635a0fc None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:29.234744 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e3fba-e244-4feb-a4c7-fb27d635a0fc None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:29.235080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e3fba-e244-4feb-a4c7-fb27d635a0fc None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:29.236802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 257/517] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:29.242932 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a0348-e244-457d-8bc4-a34edce8bbd5 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:29.243208 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a0348-e244-457d-8bc4-a34edce8bbd5 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:29.243476 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a0348-e244-457d-8bc4-a34edce8bbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:29.253154 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f101146-059f-48f6-bbe8-e113f8e8389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:29.254066 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f101146-059f-48f6-bbe8-e113f8e8389a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:29.254615 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f101146-059f-48f6-bbe8-e113f8e8389a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:29.255073 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f101146-059f-48f6-bbe8-e113f8e8389a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:29.256779 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f101146-059f-48f6-bbe8-e113f8e8389a None admin] RBAC: Adding query filter params (role.id=fde247f30afe4b81958b67c776cabec0, scope.project.id=75fce313b5e242adb9eb825bc017e358, user.id=cc6df159e6dc419cae222ebc3e5c99f4) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:29.257167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f101146-059f-48f6-bbe8-e113f8e8389a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:29.258697 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f101146-059f-48f6-bbe8-e113f8e8389a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:29.262519 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-f91a0348-e244-457d-8bc4-a34edce8bbd5 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:29.263882 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-f91a0348-e244-457d-8bc4-a34edce8bbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:29.272841 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 261/518] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:06:29 2022] GET /identity/v3/role_assignments?user.id=cc6df159e6dc419cae222ebc3e5c99f4&scope.project.id=75fce313b5e242adb9eb825bc017e358&role.id=fde247f30afe4b81958b67c776cabec0 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:29.347450 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 258/519] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:29 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:29.573101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f101146-059f-48f6-bbe8-e113f8e8389a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:29.675174 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a0348-e244-457d-8bc4-a34edce8bbd5 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:29.682097 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f101146-059f-48f6-bbe8-e113f8e8389a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:29.721344 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d0f27-3d1c-4be9-8299-b9477087331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:29.721964 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d0f27-3d1c-4be9-8299-b9477087331a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:29.722242 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d0f27-3d1c-4be9-8299-b9477087331a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:29.722509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d0f27-3d1c-4be9-8299-b9477087331a None admin] PATH_INFO: `/v3/services/image` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:29.723086 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d0f27-3d1c-4be9-8299-b9477087331a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:29.725032 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d0f27-3d1c-4be9-8299-b9477087331a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-104d0f27-3d1c-4be9-8299-b9477087331a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:29.734331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:29.735494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:29.736957 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 262/520] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Oct 20 19:06:29 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:29.742890 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d0f27-3d1c-4be9-8299-b9477087331a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:29.780039 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:29.797519 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a0348-e244-457d-8bc4-a34edce8bbd5 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:29.806916 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:29.837135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339c66e-7e22-4567-b48c-55b1fb923905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:29.838153 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c66e-7e22-4567-b48c-55b1fb923905 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:29.838628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c66e-7e22-4567-b48c-55b1fb923905 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:29.839162 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c66e-7e22-4567-b48c-55b1fb923905 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:29.839966 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339c66e-7e22-4567-b48c-55b1fb923905 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:29.841753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339c66e-7e22-4567-b48c-55b1fb923905 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-a339c66e-7e22-4567-b48c-55b1fb923905 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:29.851753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:29.852828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 19:06:29.853645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:29.856424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 259/521] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Oct 20 19:06:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:29.861905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339c66e-7e22-4567-b48c-55b1fb923905 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:29.871710 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d0f27-3d1c-4be9-8299-b9477087331a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:29.908738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45568e4b-0808-4bee-8580-60be48ad9069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:29.909450 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45568e4b-0808-4bee-8580-60be48ad9069 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:29.909765 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45568e4b-0808-4bee-8580-60be48ad9069 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:29.909956 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45568e4b-0808-4bee-8580-60be48ad9069 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:29.910601 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45568e4b-0808-4bee-8580-60be48ad9069 None admin] RBAC: Adding query filter params (name=image) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:29.910896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45568e4b-0808-4bee-8580-60be48ad9069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:29.912684 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45568e4b-0808-4bee-8580-60be48ad9069 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:29.917716 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 263/522] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:29.918841 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af326f2-9957-424d-ab0e-91d1a6ce17bb None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:29.919126 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af326f2-9957-424d-ab0e-91d1a6ce17bb None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:29.919395 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af326f2-9957-424d-ab0e-91d1a6ce17bb None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:29.920794 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 264/523] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:29.922924 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af326f2-9957-424d-ab0e-91d1a6ce17bb None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:29.972979 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339c66e-7e22-4567-b48c-55b1fb923905 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:30.008097 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a9e49-dbd1-4188-9830-aab72ef2e891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:30.008722 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a9e49-dbd1-4188-9830-aab72ef2e891 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:30.009211 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a9e49-dbd1-4188-9830-aab72ef2e891 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:30.009359 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a9e49-dbd1-4188-9830-aab72ef2e891 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:30.009865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a9e49-dbd1-4188-9830-aab72ef2e891 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:30.010163 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a9e49-dbd1-4188-9830-aab72ef2e891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:30.011512 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a9e49-dbd1-4188-9830-aab72ef2e891 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:30.015977 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 260/524] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 19:06:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:30.017128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc2e3-cc1f-40a2-8252-92f5d31b518a None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:30.017411 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc2e3-cc1f-40a2-8252-92f5d31b518a None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:30.017678 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc2e3-cc1f-40a2-8252-92f5d31b518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:30.032532 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:30.038781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-f83fc2e3-cc1f-40a2-8252-92f5d31b518a None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:30.041475 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-f83fc2e3-cc1f-40a2-8252-92f5d31b518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:30.044103 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af326f2-9957-424d-ab0e-91d1a6ce17bb None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:30.077448 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:30.079894 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b6cc1-c03d-41bd-b944-a707878492a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:30.080751 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b6cc1-c03d-41bd-b944-a707878492a1 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:30.081036 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b6cc1-c03d-41bd-b944-a707878492a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:30.081302 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b6cc1-c03d-41bd-b944-a707878492a1 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:30.081961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b6cc1-c03d-41bd-b944-a707878492a1 None admin] RBAC: Adding query filter params (type=image) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:30.082314 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b6cc1-c03d-41bd-b944-a707878492a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:30.084149 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b6cc1-c03d-41bd-b944-a707878492a1 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:30.089870 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 265/525] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:30.090678 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b6cc1-c03d-41bd-b944-a707878492a1 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:30.120905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 261/526] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:30.122059 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fc2e3-cc1f-40a2-8252-92f5d31b518a None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:30.222293 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b6cc1-c03d-41bd-b944-a707878492a1 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:30.247045 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fc2e3-cc1f-40a2-8252-92f5d31b518a None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:30.258149 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e4205-333d-4723-95bd-f39f74eef00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:30.258849 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e4205-333d-4723-95bd-f39f74eef00a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:30.259190 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e4205-333d-4723-95bd-f39f74eef00a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:30.259530 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e4205-333d-4723-95bd-f39f74eef00a None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:30.260219 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e4205-333d-4723-95bd-f39f74eef00a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:30.260618 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e4205-333d-4723-95bd-f39f74eef00a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:30.262030 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e4205-333d-4723-95bd-f39f74eef00a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:30.267336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 266/527] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 19:06:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:30.273322 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e4205-333d-4723-95bd-f39f74eef00a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:30.293504 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62588b71-964b-4a76-bd57-ad37b8173dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:30.294681 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588b71-964b-4a76-bd57-ad37b8173dc9 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:30.295166 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588b71-964b-4a76-bd57-ad37b8173dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:30.296087 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588b71-964b-4a76-bd57-ad37b8173dc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:30.297014 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62588b71-964b-4a76-bd57-ad37b8173dc9 None admin] RBAC: Adding query filter params (interface=public, service_id=242c3fd0550f43a2846d967f7d5894a0, region_id=RegionOne) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:30.297500 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62588b71-964b-4a76-bd57-ad37b8173dc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:30.299238 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:30.300408 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62588b71-964b-4a76-bd57-ad37b8173dc9 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:30.311570 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 262/528] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 19:06:30 2022] GET /identity/v3/endpoints?service_id=242c3fd0550f43a2846d967f7d5894a0&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:30.317252 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62588b71-964b-4a76-bd57-ad37b8173dc9 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:30.360648 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:30.392900 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e4205-333d-4723-95bd-f39f74eef00a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:30.435174 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dbae2-fbb6-4fba-852f-184704c6709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:30.435894 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dbae2-fbb6-4fba-852f-184704c6709d None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:30.436239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dbae2-fbb6-4fba-852f-184704c6709d None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:30.436626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380dbae2-fbb6-4fba-852f-184704c6709d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:30.437407 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dbae2-fbb6-4fba-852f-184704c6709d None admin] RBAC: Adding query filter params (interface=public, service_id=6e671b642ee74c089207e810b92deaa8, region_id=RegionOne) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:30.437784 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dbae2-fbb6-4fba-852f-184704c6709d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:30.440055 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380dbae2-fbb6-4fba-852f-184704c6709d None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:30.452747 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62588b71-964b-4a76-bd57-ad37b8173dc9 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:30.453923 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 267/529] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 19:06:30 2022] GET /identity/v3/endpoints?service_id=6e671b642ee74c089207e810b92deaa8&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:30.455012 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dbae2-fbb6-4fba-852f-184704c6709d None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:30.493551 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4edae0-1111-4606-ae5e-c73b21c24b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:30.494595 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4edae0-1111-4606-ae5e-c73b21c24b66 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:30.494595 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4edae0-1111-4606-ae5e-c73b21c24b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:30.494901 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4edae0-1111-4606-ae5e-c73b21c24b66 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:30.495576 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4edae0-1111-4606-ae5e-c73b21c24b66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:30.497031 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4edae0-1111-4606-ae5e-c73b21c24b66 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:30.502663 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 263/530] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 19:06:30 2022] GET /identity/v3/services => generated 1002 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:06:30.503514 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4edae0-1111-4606-ae5e-c73b21c24b66 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:30.573003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:30.602856 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380dbae2-fbb6-4fba-852f-184704c6709d None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:30.613787 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:30.626815 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4edae0-1111-4606-ae5e-c73b21c24b66 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:30.658874 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d90ed7-e6b1-427f-971b-fe577a0f99e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:30.660042 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90ed7-e6b1-427f-971b-fe577a0f99e6 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:30.660505 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90ed7-e6b1-427f-971b-fe577a0f99e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:30.660945 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d90ed7-e6b1-427f-971b-fe577a0f99e6 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:30.662791 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d90ed7-e6b1-427f-971b-fe577a0f99e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:30.664820 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d90ed7-e6b1-427f-971b-fe577a0f99e6 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:30.667139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7b3eb-8bf4-48a1-96c2-b8924eeb63bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:30.668009 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7b3eb-8bf4-48a1-96c2-b8924eeb63bc None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:30.668345 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7b3eb-8bf4-48a1-96c2-b8924eeb63bc None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:30.668719 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7b3eb-8bf4-48a1-96c2-b8924eeb63bc None admin] PATH_INFO: `/v3/services/network` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:30.669412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7b3eb-8bf4-48a1-96c2-b8924eeb63bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:30.670978 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7b3eb-8bf4-48a1-96c2-b8924eeb63bc None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:30.673400 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 268/531] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 19:06:30 2022] GET /identity/v3/services => generated 1002 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-8ad7b3eb-8bf4-48a1-96c2-b8924eeb63bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:30.685062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:30.686460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 19:06:30.687485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:30.689212 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 264/532] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:30 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:30.696373 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d90ed7-e6b1-427f-971b-fe577a0f99e6 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:30.826405 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d90ed7-e6b1-427f-971b-fe577a0f99e6 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:30.866858 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f2c18-1451-44b0-90a1-86aaa94e2293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:30.867481 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f2c18-1451-44b0-90a1-86aaa94e2293 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:30.867762 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f2c18-1451-44b0-90a1-86aaa94e2293 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:30.868032 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f2c18-1451-44b0-90a1-86aaa94e2293 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:30.868711 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f2c18-1451-44b0-90a1-86aaa94e2293 None admin] RBAC: Adding query filter params (name=network) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:30.869015 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f2c18-1451-44b0-90a1-86aaa94e2293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:30.870416 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f2c18-1451-44b0-90a1-86aaa94e2293 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:30.875935 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 269/533] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:30.882518 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7b3eb-8bf4-48a1-96c2-b8924eeb63bc None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:30.995229 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7b3eb-8bf4-48a1-96c2-b8924eeb63bc None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:31.030462 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d75c-2d9c-44da-889a-ca9ad18b1e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:31.031065 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d75c-2d9c-44da-889a-ca9ad18b1e14 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:31.031393 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d75c-2d9c-44da-889a-ca9ad18b1e14 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:31.031670 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d75c-2d9c-44da-889a-ca9ad18b1e14 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:31.032316 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d75c-2d9c-44da-889a-ca9ad18b1e14 None admin] RBAC: Adding query filter params (type=network) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:31.032669 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d75c-2d9c-44da-889a-ca9ad18b1e14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:31.034203 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d75c-2d9c-44da-889a-ca9ad18b1e14 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:31.040418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 265/534] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:31.046693 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f2c18-1451-44b0-90a1-86aaa94e2293 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:31.063177 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:31.155405 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f2c18-1451-44b0-90a1-86aaa94e2293 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:31.191581 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000a764-ce4b-4bd8-9b19-778b6379789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:31.192586 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000a764-ce4b-4bd8-9b19-778b6379789a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:31.193144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000a764-ce4b-4bd8-9b19-778b6379789a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:31.193610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000a764-ce4b-4bd8-9b19-778b6379789a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:31.194617 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000a764-ce4b-4bd8-9b19-778b6379789a None admin] RBAC: Adding query filter params (interface=public, service_id=713104a9f4af4f9994854f14f956f938, region_id=RegionOne) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:31.195186 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000a764-ce4b-4bd8-9b19-778b6379789a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:31.196810 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000a764-ce4b-4bd8-9b19-778b6379789a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:31.203022 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 270/535] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 19:06:31 2022] GET /identity/v3/endpoints?service_id=713104a9f4af4f9994854f14f956f938&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:31.212322 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d75c-2d9c-44da-889a-ca9ad18b1e14 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:31.234620 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:31.321180 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d75c-2d9c-44da-889a-ca9ad18b1e14 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:31.358546 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1c9a0-6b18-430a-afe3-96d89a42148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:31.359159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1c9a0-6b18-430a-afe3-96d89a42148b None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:31.359434 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1c9a0-6b18-430a-afe3-96d89a42148b None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:31.359701 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1c9a0-6b18-430a-afe3-96d89a42148b None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:31.360391 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1c9a0-6b18-430a-afe3-96d89a42148b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:31.361775 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1c9a0-6b18-430a-afe3-96d89a42148b None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:31.369181 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 266/536] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 19:06:31 2022] GET /identity/v3/services => generated 1002 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:06:31.821928 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510369-81c4-407f-a03b-257bc5841617 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:31.822212 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510369-81c4-407f-a03b-257bc5841617 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:31.822481 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64510369-81c4-407f-a03b-257bc5841617 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:31.824060 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 271/537] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:31.829377 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff769e-0892-416e-9d6b-cbc07a6c464c None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:31.829764 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff769e-0892-416e-9d6b-cbc07a6c464c None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:31.830185 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff769e-0892-416e-9d6b-cbc07a6c464c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:31.848780 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-24ff769e-0892-416e-9d6b-cbc07a6c464c None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:31.850567 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-24ff769e-0892-416e-9d6b-cbc07a6c464c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:31.925551 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 267/538] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:32.249531 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64510369-81c4-407f-a03b-257bc5841617 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:32.333187 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:32.357170 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64510369-81c4-407f-a03b-257bc5841617 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:32.390396 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b1586-66a2-499a-a86c-2cb251124b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:32.391007 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b1586-66a2-499a-a86c-2cb251124b57 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:32.391279 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b1586-66a2-499a-a86c-2cb251124b57 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:32.391543 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b1586-66a2-499a-a86c-2cb251124b57 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:32.392109 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b1586-66a2-499a-a86c-2cb251124b57 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:32.393470 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b1586-66a2-499a-a86c-2cb251124b57 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-879b1586-66a2-499a-a86c-2cb251124b57 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:32.402151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:32.403087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:32.403959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 272/539] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Oct 20 19:06:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:32.411265 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff769e-0892-416e-9d6b-cbc07a6c464c None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:32.428239 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:32.522568 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff769e-0892-416e-9d6b-cbc07a6c464c None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:32.564563 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f45c2-874b-4227-9f88-90cb0741f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:32.565527 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f45c2-874b-4227-9f88-90cb0741f2da None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:32.566028 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f45c2-874b-4227-9f88-90cb0741f2da None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:32.566510 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f45c2-874b-4227-9f88-90cb0741f2da None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:32.567337 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f45c2-874b-4227-9f88-90cb0741f2da None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:32.568438 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f45c2-874b-4227-9f88-90cb0741f2da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:32.570075 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f45c2-874b-4227-9f88-90cb0741f2da None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:32.575361 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 268/540] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 19:06:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:32.581186 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b1586-66a2-499a-a86c-2cb251124b57 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:32.700293 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b1586-66a2-499a-a86c-2cb251124b57 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:32.729347 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb801f-451a-48ea-b2fa-0951ec19caf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:32.729954 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb801f-451a-48ea-b2fa-0951ec19caf7 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:32.730227 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb801f-451a-48ea-b2fa-0951ec19caf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:32.730495 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb801f-451a-48ea-b2fa-0951ec19caf7 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:32.731117 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb801f-451a-48ea-b2fa-0951ec19caf7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:32.731415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb801f-451a-48ea-b2fa-0951ec19caf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:32.732789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb801f-451a-48ea-b2fa-0951ec19caf7 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:32.737789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 273/541] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 19:06:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:33.112959 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961718-c349-41c1-9762-f6b6df620c9b None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:33.113661 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961718-c349-41c1-9762-f6b6df620c9b None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:33.114131 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961718-c349-41c1-9762-f6b6df620c9b None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:33.116175 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 269/542] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:33.121693 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f412db-3616-479e-b0ce-503223fce2cb None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:33.121977 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f412db-3616-479e-b0ce-503223fce2cb None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:33.122248 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f412db-3616-479e-b0ce-503223fce2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:33.129572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:33.145363 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-f2f412db-3616-479e-b0ce-503223fce2cb None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:33.146804 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-f2f412db-3616-479e-b0ce-503223fce2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:33.218379 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 274/543] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:33 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:33.254533 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1a306-e60e-4b20-a1b0-4ccbd0f0c77d None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:33.254858 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1a306-e60e-4b20-a1b0-4ccbd0f0c77d None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:33.255085 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1a306-e60e-4b20-a1b0-4ccbd0f0c77d None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:33.257356 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 270/544] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:33.263478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15631aa5-7523-4a57-a03e-34dd6d0043b4 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:33.263942 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15631aa5-7523-4a57-a03e-34dd6d0043b4 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:33.264039 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15631aa5-7523-4a57-a03e-34dd6d0043b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:33.283124 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-15631aa5-7523-4a57-a03e-34dd6d0043b4 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:33.284332 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-15631aa5-7523-4a57-a03e-34dd6d0043b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:33.354268 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 275/545] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:33 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:33.543446 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1a306-e60e-4b20-a1b0-4ccbd0f0c77d None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:33.629825 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:33.662456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1a306-e60e-4b20-a1b0-4ccbd0f0c77d None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:33.710524 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15631aa5-7523-4a57-a03e-34dd6d0043b4 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:33.739383 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36335a69-41bb-495f-bdc8-25bebbeded2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:33.741119 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36335a69-41bb-495f-bdc8-25bebbeded2d None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:33.741824 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36335a69-41bb-495f-bdc8-25bebbeded2d None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:33.742581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36335a69-41bb-495f-bdc8-25bebbeded2d None admin] PATH_INFO: `/v3/services/image` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:33.744618 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36335a69-41bb-495f-bdc8-25bebbeded2d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:33.746825 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36335a69-41bb-495f-bdc8-25bebbeded2d None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-36335a69-41bb-495f-bdc8-25bebbeded2d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:33.760309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:33.761389 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 19:06:33.762234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:33.769591 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 271/546] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Oct 20 19:06:33 2022] GET /identity/v3/services/image => generated 86 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:33.771132 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36335a69-41bb-495f-bdc8-25bebbeded2d None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:33.852848 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:33.878727 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36335a69-41bb-495f-bdc8-25bebbeded2d None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:33.916749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fa2f6-9874-4ba9-96fc-10b17fc963c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:33.917715 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa2f6-9874-4ba9-96fc-10b17fc963c5 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:33.918186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa2f6-9874-4ba9-96fc-10b17fc963c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:33.918649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa2f6-9874-4ba9-96fc-10b17fc963c5 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:33.919482 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fa2f6-9874-4ba9-96fc-10b17fc963c5 None admin] RBAC: Adding query filter params (name=image) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:33.919993 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fa2f6-9874-4ba9-96fc-10b17fc963c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:33.921592 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fa2f6-9874-4ba9-96fc-10b17fc963c5 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:33.931362 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 272/547] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:33.933019 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a2606-b8cd-4db2-8104-d3025f0b34f0 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:33.933515 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a2606-b8cd-4db2-8104-d3025f0b34f0 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:33.933974 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a2606-b8cd-4db2-8104-d3025f0b34f0 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:33.936107 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 273/548] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:33.936944 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a2606-b8cd-4db2-8104-d3025f0b34f0 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:33.947736 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:33.952360 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15631aa5-7523-4a57-a03e-34dd6d0043b4 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:34.001212 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8201a68-6a61-4ff2-adda-703fe08eb928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:34.001999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8201a68-6a61-4ff2-adda-703fe08eb928 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:34.002376 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8201a68-6a61-4ff2-adda-703fe08eb928 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:34.002744 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8201a68-6a61-4ff2-adda-703fe08eb928 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:34.003428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8201a68-6a61-4ff2-adda-703fe08eb928 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:34.006234 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8201a68-6a61-4ff2-adda-703fe08eb928 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-d8201a68-6a61-4ff2-adda-703fe08eb928 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:34.017422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:34.018646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 19:06:34.019694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:34.025664 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 276/549] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Oct 20 19:06:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:34.025664 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84965-e602-4f1f-9ba5-48e919906b23 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:34.025664 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84965-e602-4f1f-9ba5-48e919906b23 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:34.025664 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84965-e602-4f1f-9ba5-48e919906b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:34.045459 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-d2e84965-e602-4f1f-9ba5-48e919906b23 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:34.046655 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-d2e84965-e602-4f1f-9ba5-48e919906b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:34.062864 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a2606-b8cd-4db2-8104-d3025f0b34f0 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:34.108376 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f735f-4110-4ce8-8fa3-b6d9c7cc8fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:34.108977 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f735f-4110-4ce8-8fa3-b6d9c7cc8fd3 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:34.109250 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f735f-4110-4ce8-8fa3-b6d9c7cc8fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:34.109452 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f735f-4110-4ce8-8fa3-b6d9c7cc8fd3 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:34.110047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f735f-4110-4ce8-8fa3-b6d9c7cc8fd3 None admin] RBAC: Adding query filter params (type=image) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:34.110341 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f735f-4110-4ce8-8fa3-b6d9c7cc8fd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:34.111687 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f735f-4110-4ce8-8fa3-b6d9c7cc8fd3 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:34.122337 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 274/550] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:34.122337 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f735f-4110-4ce8-8fa3-b6d9c7cc8fd3 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:34.127853 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 277/551] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:34.133245 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e84965-e602-4f1f-9ba5-48e919906b23 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:34.207616 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:34.210889 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:34.245614 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f735f-4110-4ce8-8fa3-b6d9c7cc8fd3 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:34.270714 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e84965-e602-4f1f-9ba5-48e919906b23 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:34.291647 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aeff92-7b5d-4ab9-a64d-a37a5661ebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:34.292783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeff92-7b5d-4ab9-a64d-a37a5661ebd0 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:34.293200 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeff92-7b5d-4ab9-a64d-a37a5661ebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:34.293857 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeff92-7b5d-4ab9-a64d-a37a5661ebd0 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:34.295033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aeff92-7b5d-4ab9-a64d-a37a5661ebd0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:34.295492 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aeff92-7b5d-4ab9-a64d-a37a5661ebd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:34.297022 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aeff92-7b5d-4ab9-a64d-a37a5661ebd0 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:34.308462 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 275/552] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 19:06:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:34.310483 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aeff92-7b5d-4ab9-a64d-a37a5661ebd0 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:34.316922 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80832160-be7d-473d-bc22-3ad37d23edc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:34.317523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80832160-be7d-473d-bc22-3ad37d23edc0 None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:34.317826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80832160-be7d-473d-bc22-3ad37d23edc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:34.318088 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80832160-be7d-473d-bc22-3ad37d23edc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:34.318884 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80832160-be7d-473d-bc22-3ad37d23edc0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:34.320298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80832160-be7d-473d-bc22-3ad37d23edc0 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:34.356297 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 278/553] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:06:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:34.450542 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aeff92-7b5d-4ab9-a64d-a37a5661ebd0 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:34.455441 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80832160-be7d-473d-bc22-3ad37d23edc0 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:34.498333 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:34.509631 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf90c67-ea2d-49bb-b666-fed6b18ef94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:34.510266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90c67-ea2d-49bb-b666-fed6b18ef94b None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:34.510556 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90c67-ea2d-49bb-b666-fed6b18ef94b None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:34.510817 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf90c67-ea2d-49bb-b666-fed6b18ef94b None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:34.511651 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf90c67-ea2d-49bb-b666-fed6b18ef94b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:34.511951 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf90c67-ea2d-49bb-b666-fed6b18ef94b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:34.513364 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf90c67-ea2d-49bb-b666-fed6b18ef94b None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:34.523904 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 276/554] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Oct 20 19:06:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:34.525317 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf90c67-ea2d-49bb-b666-fed6b18ef94b None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:34.576524 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80832160-be7d-473d-bc22-3ad37d23edc0 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:34.594291 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:34.620806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afdc07-5bcf-40e6-958f-ba47fc445414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:34.621793 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afdc07-5bcf-40e6-958f-ba47fc445414 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:34.622312 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afdc07-5bcf-40e6-958f-ba47fc445414 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:34.622591 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afdc07-5bcf-40e6-958f-ba47fc445414 None admin] PATH_INFO: `/v3/services/network` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:34.623178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afdc07-5bcf-40e6-958f-ba47fc445414 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:34.624641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afdc07-5bcf-40e6-958f-ba47fc445414 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-e2afdc07-5bcf-40e6-958f-ba47fc445414 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:34.636167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:34.637412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:34.638237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 279/555] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:34 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:06:34.643508 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afdc07-5bcf-40e6-958f-ba47fc445414 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:34.673671 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf90c67-ea2d-49bb-b666-fed6b18ef94b None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:34.712643 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca016ecf-b5a6-4231-8b2c-3f7d8a2011f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:34.713171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca016ecf-b5a6-4231-8b2c-3f7d8a2011f0 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:34.713444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca016ecf-b5a6-4231-8b2c-3f7d8a2011f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:34.713712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca016ecf-b5a6-4231-8b2c-3f7d8a2011f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:34.714377 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca016ecf-b5a6-4231-8b2c-3f7d8a2011f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:34.715741 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca016ecf-b5a6-4231-8b2c-3f7d8a2011f0 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:34.744806 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 277/556] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:06:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:34.787920 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afdc07-5bcf-40e6-958f-ba47fc445414 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:34.836600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90079a-a4f3-45d8-b2cb-ee22d3da2538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:34.837307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90079a-a4f3-45d8-b2cb-ee22d3da2538 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:34.837572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90079a-a4f3-45d8-b2cb-ee22d3da2538 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:34.837846 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90079a-a4f3-45d8-b2cb-ee22d3da2538 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:34.838588 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90079a-a4f3-45d8-b2cb-ee22d3da2538 None admin] RBAC: Adding query filter params (name=network) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:34.838901 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90079a-a4f3-45d8-b2cb-ee22d3da2538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:34.840581 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90079a-a4f3-45d8-b2cb-ee22d3da2538 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:34.847110 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 280/557] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:34.853458 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca016ecf-b5a6-4231-8b2c-3f7d8a2011f0 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:34.915130 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:34.978441 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca016ecf-b5a6-4231-8b2c-3f7d8a2011f0 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:35.014495 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb925f9-45cb-48e5-aa8d-2b2d6b4990a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:35.015466 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb925f9-45cb-48e5-aa8d-2b2d6b4990a6 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:35.015969 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb925f9-45cb-48e5-aa8d-2b2d6b4990a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:35.016468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb925f9-45cb-48e5-aa8d-2b2d6b4990a6 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:35.017297 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb925f9-45cb-48e5-aa8d-2b2d6b4990a6 None admin] RBAC: Adding query filter params (type=network) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:35.017878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb925f9-45cb-48e5-aa8d-2b2d6b4990a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:35.019541 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb925f9-45cb-48e5-aa8d-2b2d6b4990a6 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:35.025555 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 278/558] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:35.031009 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90079a-a4f3-45d8-b2cb-ee22d3da2538 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:35.078325 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:35.145132 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90079a-a4f3-45d8-b2cb-ee22d3da2538 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:35.183850 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0996fb-3193-4cae-a4c6-9d91ecadb355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:35.184855 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0996fb-3193-4cae-a4c6-9d91ecadb355 None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:35.185368 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0996fb-3193-4cae-a4c6-9d91ecadb355 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:35.185842 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0996fb-3193-4cae-a4c6-9d91ecadb355 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:35.186696 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0996fb-3193-4cae-a4c6-9d91ecadb355 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:35.188280 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0996fb-3193-4cae-a4c6-9d91ecadb355 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:35.213423 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 281/559] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:06:35 2022] POST /identity/v3/endpoints => generated 337 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:35.296314 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e49f-0469-4dde-9ffc-ea45cc28ecd6 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:35.296645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e49f-0469-4dde-9ffc-ea45cc28ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:35.296827 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1e49f-0469-4dde-9ffc-ea45cc28ecd6 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:35.298571 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 279/560] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:35.305098 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44ec57-d600-41bf-97a9-3e5521fc2c53 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:35.305665 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44ec57-d600-41bf-97a9-3e5521fc2c53 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:35.305871 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44ec57-d600-41bf-97a9-3e5521fc2c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:35.326460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-cd44ec57-d600-41bf-97a9-3e5521fc2c53 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:35.327684 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-cd44ec57-d600-41bf-97a9-3e5521fc2c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:35.419199 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 282/561] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:35 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:35.742082 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1e49f-0469-4dde-9ffc-ea45cc28ecd6 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:35.846361 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1e49f-0469-4dde-9ffc-ea45cc28ecd6 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:35.860723 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:35.881562 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc042f-9647-4412-a0f5-dd31af5bc803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:35.882227 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc042f-9647-4412-a0f5-dd31af5bc803 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:35.882494 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc042f-9647-4412-a0f5-dd31af5bc803 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:35.882758 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc042f-9647-4412-a0f5-dd31af5bc803 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:35.883400 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc042f-9647-4412-a0f5-dd31af5bc803 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:35.884782 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc042f-9647-4412-a0f5-dd31af5bc803 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:35.900314 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 280/562] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 19:06:35 2022] POST /identity/v3/services => generated 269 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:36.936196 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88d4f-78f4-427b-b1df-109f4aac3668 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:36.936732 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88d4f-78f4-427b-b1df-109f4aac3668 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:36.936837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc88d4f-78f4-427b-b1df-109f4aac3668 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:36.938264 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 283/563] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:36.943724 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757235b9-db5d-43e4-8807-340bec02b706 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:36.944136 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757235b9-db5d-43e4-8807-340bec02b706 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:36.944349 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757235b9-db5d-43e4-8807-340bec02b706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:36.962940 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-757235b9-db5d-43e4-8807-340bec02b706 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:36.964045 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-757235b9-db5d-43e4-8807-340bec02b706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:37.040830 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 281/564] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:36 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:37.240683 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583f7eb-fb5c-417a-989f-c43f8644a72c None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:37.240894 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583f7eb-fb5c-417a-989f-c43f8644a72c None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:37.241224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583f7eb-fb5c-417a-989f-c43f8644a72c None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:37.242457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 284/565] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:37.247743 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc24c7-0ca8-41fc-a436-68117152c910 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:37.248026 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc24c7-0ca8-41fc-a436-68117152c910 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:37.248327 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc24c7-0ca8-41fc-a436-68117152c910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:37.267043 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-cbdc24c7-0ca8-41fc-a436-68117152c910 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:37.268199 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-cbdc24c7-0ca8-41fc-a436-68117152c910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:37.344317 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 282/566] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:37 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 19:06:37.364810 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583f7eb-fb5c-417a-989f-c43f8644a72c None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:37.387698 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:37.469578 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583f7eb-fb5c-417a-989f-c43f8644a72c None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:37.503035 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96727f24-97cf-410b-b728-01c76d0fca83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:37.503559 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96727f24-97cf-410b-b728-01c76d0fca83 None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:37.503831 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96727f24-97cf-410b-b728-01c76d0fca83 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:37.504095 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96727f24-97cf-410b-b728-01c76d0fca83 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:37.504781 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96727f24-97cf-410b-b728-01c76d0fca83 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:37.506674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96727f24-97cf-410b-b728-01c76d0fca83 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:37.514370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.sql.core [None req-96727f24-97cf-410b-b728-01c76d0fca83 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 19:06:37.514370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 19:06:37.514370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [parameters: {'id': '8a1d418c57b24c7b93dc7a48738bc446', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 19:06:37.514370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88308) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-96727f24-97cf-410b-b728-01c76d0fca83 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application conn.query(q) Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 19:06:37.521906 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application result.read() Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 19:06:37.522734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application next(self.gen) Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application yield resource Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application next(self.gen) Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise self.value Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application session.commit() Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 19:06:37.523763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self.session.flush() Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application compat.raise_( Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 19:06:37.525178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 19:06:37.526067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application conn.query(q) Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application result.read() Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 19:06:37.527330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [parameters: {'id': '8a1d418c57b24c7b93dc7a48738bc446', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 19:06:37.529800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:37.531535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 19:06:37.532966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:37.534436 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc24c7-0ca8-41fc-a436-68117152c910 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:37.534653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 285/567] 10.222.0.16 () {60 vars in 1137 bytes} [Thu Oct 20 19:06:37 2022] POST /identity/v3/domains => generated 190 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:37.561132 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:37.632567 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc24c7-0ca8-41fc-a436-68117152c910 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:37.665785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae893753-52b8-4f90-9f82-918377dab6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:37.666657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893753-52b8-4f90-9f82-918377dab6e3 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:37.666929 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893753-52b8-4f90-9f82-918377dab6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:37.667190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae893753-52b8-4f90-9f82-918377dab6e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:37.677146 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae893753-52b8-4f90-9f82-918377dab6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:37.678683 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae893753-52b8-4f90-9f82-918377dab6e3 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:37.678795 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96727f24-97cf-410b-b728-01c76d0fca83 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-ae893753-52b8-4f90-9f82-918377dab6e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:06:37.703104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:37.704038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:06:37.705006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:06:37.705006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:06:37.705006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:37.705006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 283/568] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:37.710739 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae893753-52b8-4f90-9f82-918377dab6e3 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:37.774741 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:37.796970 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96727f24-97cf-410b-b728-01c76d0fca83 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:37.798143 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:37.817740 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae893753-52b8-4f90-9f82-918377dab6e3 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:37.839430 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18769711-5b36-4805-bc53-aefccd6a900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:37.840074 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769711-5b36-4805-bc53-aefccd6a900d None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:37.840377 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769711-5b36-4805-bc53-aefccd6a900d None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:37.840829 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769711-5b36-4805-bc53-aefccd6a900d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:37.841310 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18769711-5b36-4805-bc53-aefccd6a900d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:37.842677 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18769711-5b36-4805-bc53-aefccd6a900d None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:37.851779 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8680703-0882-484f-a7de-ccaefbbf9961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:37.852399 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680703-0882-484f-a7de-ccaefbbf9961 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:37.852672 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680703-0882-484f-a7de-ccaefbbf9961 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:37.852937 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8680703-0882-484f-a7de-ccaefbbf9961 None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:37.853568 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8680703-0882-484f-a7de-ccaefbbf9961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-18769711-5b36-4805-bc53-aefccd6a900d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:37.853739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:37.854670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 19:06:37.855988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:37.856767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8680703-0882-484f-a7de-ccaefbbf9961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:37.856838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 286/569] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:06:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:06:37.859868 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8680703-0882-484f-a7de-ccaefbbf9961 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:37.860439 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18769711-5b36-4805-bc53-aefccd6a900d None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:37.872489 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 284/570] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:37.989573 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18769711-5b36-4805-bc53-aefccd6a900d None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:38.026498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdf61a-1147-46c8-91dc-31c3127c45a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:38.027031 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf61a-1147-46c8-91dc-31c3127c45a4 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:38.027311 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf61a-1147-46c8-91dc-31c3127c45a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:38.027582 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdf61a-1147-46c8-91dc-31c3127c45a4 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:38.028308 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdf61a-1147-46c8-91dc-31c3127c45a4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:38.028620 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdf61a-1147-46c8-91dc-31c3127c45a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:38.030008 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdf61a-1147-46c8-91dc-31c3127c45a4 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:38.035304 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 287/571] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:06:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:38.041383 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8680703-0882-484f-a7de-ccaefbbf9961 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:38.147875 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8680703-0882-484f-a7de-ccaefbbf9961 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:38.183248 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a5a37-04ee-4c52-82a0-ff6f49658a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:38.183861 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a5a37-04ee-4c52-82a0-ff6f49658a03 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:38.184137 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a5a37-04ee-4c52-82a0-ff6f49658a03 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:38.184438 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a5a37-04ee-4c52-82a0-ff6f49658a03 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:38.185065 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a5a37-04ee-4c52-82a0-ff6f49658a03 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:38.185363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a5a37-04ee-4c52-82a0-ff6f49658a03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:38.186738 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a5a37-04ee-4c52-82a0-ff6f49658a03 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:38.191777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 285/572] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:06:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:38.354531 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c41d6a-2871-452c-9d19-4f530683cd12 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:38.354723 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c41d6a-2871-452c-9d19-4f530683cd12 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:38.354992 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c41d6a-2871-452c-9d19-4f530683cd12 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:38.356444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 288/573] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:38.362264 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705899ec-80b2-4520-a8c3-1268937812a2 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:38.362626 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705899ec-80b2-4520-a8c3-1268937812a2 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:38.362984 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705899ec-80b2-4520-a8c3-1268937812a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:38.377255 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:38.382824 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-705899ec-80b2-4520-a8c3-1268937812a2 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:38.384085 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-705899ec-80b2-4520-a8c3-1268937812a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:38.451089 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 286/574] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:38 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:38.775460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c41d6a-2871-452c-9d19-4f530683cd12 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:38.792912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:38.877534 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c41d6a-2871-452c-9d19-4f530683cd12 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:38.910335 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ecf8-b956-414b-b3b4-3f329c3f48ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:38.910945 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ecf8-b956-414b-b3b4-3f329c3f48ee None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:38.911324 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ecf8-b956-414b-b3b4-3f329c3f48ee None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:38.911639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ecf8-b956-414b-b3b4-3f329c3f48ee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:38.912206 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78ecf8-b956-414b-b3b4-3f329c3f48ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:38.913596 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78ecf8-b956-414b-b3b4-3f329c3f48ee None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-cf78ecf8-b956-414b-b3b4-3f329c3f48ee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:38.922336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:38.924457 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:38.925388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 289/575] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Oct 20 19:06:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:38.929820 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705899ec-80b2-4520-a8c3-1268937812a2 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:39.024800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705899ec-80b2-4520-a8c3-1268937812a2 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:39.057918 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35ee50-633a-4aa7-8af7-0fcd4e6e0663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:39.058536 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35ee50-633a-4aa7-8af7-0fcd4e6e0663 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:39.058778 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35ee50-633a-4aa7-8af7-0fcd4e6e0663 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:39.059041 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35ee50-633a-4aa7-8af7-0fcd4e6e0663 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:39.059654 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35ee50-633a-4aa7-8af7-0fcd4e6e0663 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:39.059951 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35ee50-633a-4aa7-8af7-0fcd4e6e0663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:39.061376 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35ee50-633a-4aa7-8af7-0fcd4e6e0663 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:39.063026 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:39.066676 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 287/576] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 19:06:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:39.072838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ecf8-b956-414b-b3b4-3f329c3f48ee None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:39.148361 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:39.170002 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ecf8-b956-414b-b3b4-3f329c3f48ee None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:39.201742 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa44331-1de4-45c2-87be-6a1217924d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:39.202322 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa44331-1de4-45c2-87be-6a1217924d2b None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:39.202593 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa44331-1de4-45c2-87be-6a1217924d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:39.202855 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa44331-1de4-45c2-87be-6a1217924d2b None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:39.203462 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa44331-1de4-45c2-87be-6a1217924d2b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:39.203756 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa44331-1de4-45c2-87be-6a1217924d2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:39.205116 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa44331-1de4-45c2-87be-6a1217924d2b None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:39.210214 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 290/577] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 19:06:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:39.216075 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35ee50-633a-4aa7-8af7-0fcd4e6e0663 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:39.312321 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35ee50-633a-4aa7-8af7-0fcd4e6e0663 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:39.348239 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3692474-61fa-4afa-bdcf-afc353d332cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:39.348891 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692474-61fa-4afa-bdcf-afc353d332cd None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:39.349221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692474-61fa-4afa-bdcf-afc353d332cd None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:39.349479 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692474-61fa-4afa-bdcf-afc353d332cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:39.350131 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3692474-61fa-4afa-bdcf-afc353d332cd None admin] RBAC: Adding query filter params (interface=public, service_id=02bc16e523e64cdfb0f2f38c92da4b2a, region_id=RegionOne) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:39.350451 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3692474-61fa-4afa-bdcf-afc353d332cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:39.351974 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3692474-61fa-4afa-bdcf-afc353d332cd None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:39.357148 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 288/578] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 19:06:39 2022] GET /identity/v3/endpoints?service_id=02bc16e523e64cdfb0f2f38c92da4b2a&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:39.362781 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa44331-1de4-45c2-87be-6a1217924d2b None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:39.459256 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa44331-1de4-45c2-87be-6a1217924d2b None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:39.491746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac718d44-b22d-4845-85eb-c03500b257ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:39.492463 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac718d44-b22d-4845-85eb-c03500b257ec None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:39.492738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac718d44-b22d-4845-85eb-c03500b257ec None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:39.493005 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac718d44-b22d-4845-85eb-c03500b257ec None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:39.493597 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac718d44-b22d-4845-85eb-c03500b257ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:39.494940 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac718d44-b22d-4845-85eb-c03500b257ec None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:39.500464 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 291/579] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 19:06:39 2022] GET /identity/v3/services => generated 1259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:06:40.585195 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b9b78-d6ca-4587-bb5c-5ec61b1794a3 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:40.585733 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b9b78-d6ca-4587-bb5c-5ec61b1794a3 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:40.585733 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b9b78-d6ca-4587-bb5c-5ec61b1794a3 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:40.587075 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 289/580] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:06:40.592422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efda5-e944-47df-b476-02401ed5dde4 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:40.592830 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efda5-e944-47df-b476-02401ed5dde4 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:40.592976 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669efda5-e944-47df-b476-02401ed5dde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:40.600754 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:40.611891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-669efda5-e944-47df-b476-02401ed5dde4 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:40.613135 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-669efda5-e944-47df-b476-02401ed5dde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:40.679576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 292/581] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:40 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:40.999010 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b9b78-d6ca-4587-bb5c-5ec61b1794a3 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:41.059690 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:41.096771 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b9b78-d6ca-4587-bb5c-5ec61b1794a3 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:41.129140 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8c2a1-4624-4de8-8dab-eba45a344514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:41.130299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8c2a1-4624-4de8-8dab-eba45a344514 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:41.130576 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8c2a1-4624-4de8-8dab-eba45a344514 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:41.130841 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8c2a1-4624-4de8-8dab-eba45a344514 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:41.131476 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8c2a1-4624-4de8-8dab-eba45a344514 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:41.132858 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8c2a1-4624-4de8-8dab-eba45a344514 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:41.146676 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 290/582] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 19:06:40 2022] POST /identity/v3/services => generated 251 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:41.870197 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151034-72ca-4747-81af-0bc857f05c88 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:41.870751 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151034-72ca-4747-81af-0bc857f05c88 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:41.870751 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151034-72ca-4747-81af-0bc857f05c88 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:41.872143 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 293/583] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:41.877436 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d72444-adc5-4b9a-815f-0a7d024e6cad None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:41.877821 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d72444-adc5-4b9a-815f-0a7d024e6cad None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:41.877978 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d72444-adc5-4b9a-815f-0a7d024e6cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:41.896313 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-97d72444-adc5-4b9a-815f-0a7d024e6cad None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:41.897473 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-97d72444-adc5-4b9a-815f-0a7d024e6cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:41.966676 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 291/584] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:41 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:42.283106 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151034-72ca-4747-81af-0bc857f05c88 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:42.384594 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151034-72ca-4747-81af-0bc857f05c88 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:42.417536 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f940d0-5c3f-450b-b06c-4bf3e2077a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:42.418160 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f940d0-5c3f-450b-b06c-4bf3e2077a72 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:42.418437 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f940d0-5c3f-450b-b06c-4bf3e2077a72 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:42.418703 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f940d0-5c3f-450b-b06c-4bf3e2077a72 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:42.419280 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f940d0-5c3f-450b-b06c-4bf3e2077a72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:42.420743 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f940d0-5c3f-450b-b06c-4bf3e2077a72 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:42.422520 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-b3f940d0-5c3f-450b-b06c-4bf3e2077a72 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:42.430864 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:42.431837 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:42.433082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 294/585] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Oct 20 19:06:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:42.437872 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d72444-adc5-4b9a-815f-0a7d024e6cad None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:42.485531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:42.534851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d72444-adc5-4b9a-815f-0a7d024e6cad None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:42.568812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9f142-8df7-415f-a2e2-3c26f36c071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:42.569397 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9f142-8df7-415f-a2e2-3c26f36c071c None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:42.569667 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9f142-8df7-415f-a2e2-3c26f36c071c None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:42.569928 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9f142-8df7-415f-a2e2-3c26f36c071c None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:42.570542 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9f142-8df7-415f-a2e2-3c26f36c071c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:42.570837 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9f142-8df7-415f-a2e2-3c26f36c071c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:42.572179 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9f142-8df7-415f-a2e2-3c26f36c071c None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:42.576762 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 292/586] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 19:06:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:42.582413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f940d0-5c3f-450b-b06c-4bf3e2077a72 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:42.683679 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f940d0-5c3f-450b-b06c-4bf3e2077a72 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:42.719861 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478dccf3-41c6-4b5c-9887-c659184d448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:42.720489 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dccf3-41c6-4b5c-9887-c659184d448a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:42.720764 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dccf3-41c6-4b5c-9887-c659184d448a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:42.721029 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478dccf3-41c6-4b5c-9887-c659184d448a None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:42.721641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dccf3-41c6-4b5c-9887-c659184d448a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:42.721936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dccf3-41c6-4b5c-9887-c659184d448a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:42.723276 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478dccf3-41c6-4b5c-9887-c659184d448a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:42.727824 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 295/587] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Oct 20 19:06:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:42.733483 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9f142-8df7-415f-a2e2-3c26f36c071c None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:42.833304 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9f142-8df7-415f-a2e2-3c26f36c071c None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:42.846134 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:42.867099 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f70e8-8a24-4e8a-a522-afd863c09222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:42.867681 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f70e8-8a24-4e8a-a522-afd863c09222 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:42.867952 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f70e8-8a24-4e8a-a522-afd863c09222 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:42.868214 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f70e8-8a24-4e8a-a522-afd863c09222 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:42.868887 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f70e8-8a24-4e8a-a522-afd863c09222 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:42.870223 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f70e8-8a24-4e8a-a522-afd863c09222 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:42.888683 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 293/588] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:06:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 19:06:43.574311 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a4ab-2a95-4b3c-b128-43f439b55b8b None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:43.574848 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a4ab-2a95-4b3c-b128-43f439b55b8b None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:43.574848 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a4ab-2a95-4b3c-b128-43f439b55b8b None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:43.576246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 296/589] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:43.581434 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9c6f-b1b7-4f1a-99d9-7248806110ed None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:43.581780 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9c6f-b1b7-4f1a-99d9-7248806110ed None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:43.582164 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9c6f-b1b7-4f1a-99d9-7248806110ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:43.601716 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-fb8b9c6f-b1b7-4f1a-99d9-7248806110ed None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:43.602879 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-fb8b9c6f-b1b7-4f1a-99d9-7248806110ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:43.678657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 294/590] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:43 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:43.999332 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622a4ab-2a95-4b3c-b128-43f439b55b8b None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:44.060554 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:44.100921 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622a4ab-2a95-4b3c-b128-43f439b55b8b None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:44.133403 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d141e7-2596-4f34-a7d2-5edf36cf9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:44.134033 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d141e7-2596-4f34-a7d2-5edf36cf9a07 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:44.134310 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d141e7-2596-4f34-a7d2-5edf36cf9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:44.134580 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d141e7-2596-4f34-a7d2-5edf36cf9a07 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:44.135244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d141e7-2596-4f34-a7d2-5edf36cf9a07 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:44.136654 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d141e7-2596-4f34-a7d2-5edf36cf9a07 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-83d141e7-2596-4f34-a7d2-5edf36cf9a07 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:44.146064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:44.147096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:44.147971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 297/591] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:06:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:44.153139 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b9c6f-b1b7-4f1a-99d9-7248806110ed None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:44.243080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:44.249858 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b9c6f-b1b7-4f1a-99d9-7248806110ed None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:44.283771 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d19d1-5a9c-4a50-ae59-512b595a0932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:44.284411 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d19d1-5a9c-4a50-ae59-512b595a0932 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:44.284691 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d19d1-5a9c-4a50-ae59-512b595a0932 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:44.284962 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d19d1-5a9c-4a50-ae59-512b595a0932 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:44.285589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d19d1-5a9c-4a50-ae59-512b595a0932 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:44.285934 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d19d1-5a9c-4a50-ae59-512b595a0932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:44.287300 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d19d1-5a9c-4a50-ae59-512b595a0932 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:44.292143 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 295/592] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:06:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:44.297748 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d141e7-2596-4f34-a7d2-5edf36cf9a07 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:44.397994 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d141e7-2596-4f34-a7d2-5edf36cf9a07 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:44.422375 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:44.431589 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677e32-89ad-40af-85b1-71dfb51d3dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:44.432185 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677e32-89ad-40af-85b1-71dfb51d3dcf None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:44.432492 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677e32-89ad-40af-85b1-71dfb51d3dcf None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:44.432761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb677e32-89ad-40af-85b1-71dfb51d3dcf None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:44.433377 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb677e32-89ad-40af-85b1-71dfb51d3dcf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:44.433675 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb677e32-89ad-40af-85b1-71dfb51d3dcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:44.435022 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb677e32-89ad-40af-85b1-71dfb51d3dcf None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:44.439774 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 298/593] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:06:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:44.446176 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d19d1-5a9c-4a50-ae59-512b595a0932 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:44.542652 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d19d1-5a9c-4a50-ae59-512b595a0932 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:44.577509 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729fe92-aaaa-40a5-9621-f008694306c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:44.578112 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729fe92-aaaa-40a5-9621-f008694306c2 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:44.578388 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729fe92-aaaa-40a5-9621-f008694306c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:44.578654 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729fe92-aaaa-40a5-9621-f008694306c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:44.579348 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729fe92-aaaa-40a5-9621-f008694306c2 None admin] RBAC: Adding query filter params (interface=public, service_id=09f2f077eed343d99ebdc8e6807de723, region_id=RegionOne) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:44.579654 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729fe92-aaaa-40a5-9621-f008694306c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:44.581045 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729fe92-aaaa-40a5-9621-f008694306c2 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:44.592909 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 296/594] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 19:06:44 2022] GET /identity/v3/endpoints?service_id=09f2f077eed343d99ebdc8e6807de723&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:44.594168 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677e32-89ad-40af-85b1-71dfb51d3dcf None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:44.702971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb677e32-89ad-40af-85b1-71dfb51d3dcf None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:44.740259 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff2ccc-ec85-4a9a-b0f2-c9ca48d12641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:44.740977 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff2ccc-ec85-4a9a-b0f2-c9ca48d12641 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:44.741297 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff2ccc-ec85-4a9a-b0f2-c9ca48d12641 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:44.741567 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff2ccc-ec85-4a9a-b0f2-c9ca48d12641 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:44.742170 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff2ccc-ec85-4a9a-b0f2-c9ca48d12641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:44.743528 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff2ccc-ec85-4a9a-b0f2-c9ca48d12641 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:44.749886 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 299/595] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 19:06:44 2022] GET /identity/v3/services => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:06:45.313412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293e86f-e503-4c37-a08d-f107af0f46fc None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:45.313946 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293e86f-e503-4c37-a08d-f107af0f46fc None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:45.313946 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293e86f-e503-4c37-a08d-f107af0f46fc None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:45.315261 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 297/596] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:45.321186 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cb251-86f9-4d02-adcc-89a436bb3c80 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:45.321478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cb251-86f9-4d02-adcc-89a436bb3c80 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:45.321754 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cb251-86f9-4d02-adcc-89a436bb3c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:45.340804 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-bd1cb251-86f9-4d02-adcc-89a436bb3c80 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:45.341999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-bd1cb251-86f9-4d02-adcc-89a436bb3c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:45.391761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:45.409286 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 300/597] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:45 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:45.733934 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293e86f-e503-4c37-a08d-f107af0f46fc None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:45.759741 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:45.834515 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293e86f-e503-4c37-a08d-f107af0f46fc None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:45.867727 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c24398-104a-4bc1-971d-3b08c74e5361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:45.868361 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c24398-104a-4bc1-971d-3b08c74e5361 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:45.868634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c24398-104a-4bc1-971d-3b08c74e5361 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:45.868898 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c24398-104a-4bc1-971d-3b08c74e5361 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:45.869465 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c24398-104a-4bc1-971d-3b08c74e5361 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:45.870802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c24398-104a-4bc1-971d-3b08c74e5361 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-22c24398-104a-4bc1-971d-3b08c74e5361 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:45.879171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:45.880402 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 19:06:45.881440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:45.884465 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 298/598] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:45.886314 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cb251-86f9-4d02-adcc-89a436bb3c80 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:45.981345 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cb251-86f9-4d02-adcc-89a436bb3c80 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:46.013678 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7b992-9afe-4351-bf8b-f8435ab373e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:46.014275 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7b992-9afe-4351-bf8b-f8435ab373e0 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:46.014547 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7b992-9afe-4351-bf8b-f8435ab373e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:46.014812 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7b992-9afe-4351-bf8b-f8435ab373e0 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:46.015427 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7b992-9afe-4351-bf8b-f8435ab373e0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:46.015724 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7b992-9afe-4351-bf8b-f8435ab373e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:46.017102 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7b992-9afe-4351-bf8b-f8435ab373e0 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:46.021625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 301/599] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:46.027237 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c24398-104a-4bc1-971d-3b08c74e5361 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:46.112581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:46.125535 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c24398-104a-4bc1-971d-3b08c74e5361 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:46.157877 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5dddc-e594-4b76-8000-dba64a1e9a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:46.158466 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5dddc-e594-4b76-8000-dba64a1e9a09 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:46.158737 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5dddc-e594-4b76-8000-dba64a1e9a09 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:46.159000 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5dddc-e594-4b76-8000-dba64a1e9a09 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:46.159613 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5dddc-e594-4b76-8000-dba64a1e9a09 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:46.159913 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5dddc-e594-4b76-8000-dba64a1e9a09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:46.161404 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5dddc-e594-4b76-8000-dba64a1e9a09 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:46.166125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 299/600] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:47.259414 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c4dbe-3055-492f-bd09-f5da82050f80 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:47.259987 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c4dbe-3055-492f-bd09-f5da82050f80 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:47.259987 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c4dbe-3055-492f-bd09-f5da82050f80 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:47.261319 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 302/601] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:47.266531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345f7a9-6a7d-40a7-aa3f-09c48c7e057d None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:47.266938 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345f7a9-6a7d-40a7-aa3f-09c48c7e057d None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:47.267079 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345f7a9-6a7d-40a7-aa3f-09c48c7e057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:47.285559 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-a345f7a9-6a7d-40a7-aa3f-09c48c7e057d None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:47.286840 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-a345f7a9-6a7d-40a7-aa3f-09c48c7e057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:47.353213 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 300/602] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:47 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:47.677070 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c4dbe-3055-492f-bd09-f5da82050f80 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:47.731481 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:47.784792 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c4dbe-3055-492f-bd09-f5da82050f80 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:47.819575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1a456-a328-42ab-9344-329cf48bda5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:47.820201 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a456-a328-42ab-9344-329cf48bda5d None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:47.820510 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a456-a328-42ab-9344-329cf48bda5d None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:47.820780 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a456-a328-42ab-9344-329cf48bda5d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:47.821360 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1a456-a328-42ab-9344-329cf48bda5d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:47.822705 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1a456-a328-42ab-9344-329cf48bda5d None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-b9d1a456-a328-42ab-9344-329cf48bda5d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:47.831235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:47.832387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:47.833767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 303/603] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:06:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:47.838251 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345f7a9-6a7d-40a7-aa3f-09c48c7e057d None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:47.917444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:47.935925 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345f7a9-6a7d-40a7-aa3f-09c48c7e057d None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:47.968845 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6ccec-c23f-49e7-9c00-963d73df6bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:47.969442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6ccec-c23f-49e7-9c00-963d73df6bda None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:47.969718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6ccec-c23f-49e7-9c00-963d73df6bda None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:47.969983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6ccec-c23f-49e7-9c00-963d73df6bda None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:47.970596 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6ccec-c23f-49e7-9c00-963d73df6bda None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:47.970896 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6ccec-c23f-49e7-9c00-963d73df6bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:47.972246 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6ccec-c23f-49e7-9c00-963d73df6bda None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:47.977442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 301/604] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:06:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:47.983128 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1a456-a328-42ab-9344-329cf48bda5d None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:48.080077 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1a456-a328-42ab-9344-329cf48bda5d None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:48.092358 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:48.115078 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886f0b3-0f6d-47c1-ae2e-b06af19a1adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:48.115694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886f0b3-0f6d-47c1-ae2e-b06af19a1adf None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:48.115968 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886f0b3-0f6d-47c1-ae2e-b06af19a1adf None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:48.116234 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886f0b3-0f6d-47c1-ae2e-b06af19a1adf None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:48.116933 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886f0b3-0f6d-47c1-ae2e-b06af19a1adf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:48.117232 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886f0b3-0f6d-47c1-ae2e-b06af19a1adf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:48.118638 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886f0b3-0f6d-47c1-ae2e-b06af19a1adf None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:48.124245 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 304/605] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Oct 20 19:06:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:06:48.130446 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6ccec-c23f-49e7-9c00-963d73df6bda None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:48.230283 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6ccec-c23f-49e7-9c00-963d73df6bda None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:48.263332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988296c-0d2d-4340-b4b6-4c4d98e75156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:48.263924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988296c-0d2d-4340-b4b6-4c4d98e75156 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:48.264197 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988296c-0d2d-4340-b4b6-4c4d98e75156 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:48.264489 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988296c-0d2d-4340-b4b6-4c4d98e75156 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:48.265146 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988296c-0d2d-4340-b4b6-4c4d98e75156 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:48.266491 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988296c-0d2d-4340-b4b6-4c4d98e75156 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:48.287411 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 302/606] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:06:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:48.558640 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a714a-015f-4a63-b68d-fe1ad798afa2 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:48.559134 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a714a-015f-4a63-b68d-fe1ad798afa2 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:48.559134 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a714a-015f-4a63-b68d-fe1ad798afa2 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:48.560468 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 305/607] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:48.565803 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311218-95e8-4492-ac81-88b400be1f6e None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:48.566091 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311218-95e8-4492-ac81-88b400be1f6e None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:48.566357 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311218-95e8-4492-ac81-88b400be1f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:48.572643 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:48.586841 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-86311218-95e8-4492-ac81-88b400be1f6e None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:48.588004 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-86311218-95e8-4492-ac81-88b400be1f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:48.657805 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 303/608] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:48 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 19:06:48.985690 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a714a-015f-4a63-b68d-fe1ad798afa2 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:49.084781 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a714a-015f-4a63-b68d-fe1ad798afa2 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:49.116997 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf864b-b287-4c2f-88d7-3015be14d753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:49.117586 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf864b-b287-4c2f-88d7-3015be14d753 None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:49.117856 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf864b-b287-4c2f-88d7-3015be14d753 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:49.118119 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf864b-b287-4c2f-88d7-3015be14d753 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:49.118746 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf864b-b287-4c2f-88d7-3015be14d753 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:49.120075 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf864b-b287-4c2f-88d7-3015be14d753 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:49.133882 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 306/609] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 19:06:48 2022] POST /identity/v3/services => generated 242 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:06:50.712075 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88241f2f-a935-4692-88ba-ead5090c4a48 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:50.712607 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88241f2f-a935-4692-88ba-ead5090c4a48 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:50.712696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88241f2f-a935-4692-88ba-ead5090c4a48 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:50.714017 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 304/610] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:50.719431 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10971b-3385-4ebf-b242-6c363f8b0848 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:50.719834 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10971b-3385-4ebf-b242-6c363f8b0848 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:50.720039 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10971b-3385-4ebf-b242-6c363f8b0848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:50.738222 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-4f10971b-3385-4ebf-b242-6c363f8b0848 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:50.739406 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-4f10971b-3385-4ebf-b242-6c363f8b0848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:50.766714 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:50.811660 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 307/611] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:50 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 19:06:51.140245 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88241f2f-a935-4692-88ba-ead5090c4a48 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:51.239180 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88241f2f-a935-4692-88ba-ead5090c4a48 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:51.264650 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:51.273176 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cae142-4b36-41cf-98a4-094b852aedaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:51.273765 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cae142-4b36-41cf-98a4-094b852aedaf None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:51.274035 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cae142-4b36-41cf-98a4-094b852aedaf None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:51.274298 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cae142-4b36-41cf-98a4-094b852aedaf None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:51.274935 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cae142-4b36-41cf-98a4-094b852aedaf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:51.276371 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cae142-4b36-41cf-98a4-094b852aedaf None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:51.278929 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: WARNING keystone.server.flask.common [None req-16cae142-4b36-41cf-98a4-094b852aedaf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 20 19:06:51.297556 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.sql.core [None req-16cae142-4b36-41cf-98a4-094b852aedaf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 19:06:51.297556 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 19:06:51.297556 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [parameters: {'id': '609769e623454109a5e3a537fc23e03c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 20 19:06:51.297556 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88307) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-16cae142-4b36-41cf-98a4-094b852aedaf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 609769e623454109a5e3a537fc23e03c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 609769e623454109a5e3a537fc23e03c. Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application conn.query(q) Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 19:06:51.313531 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application result.read() Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 19:06:51.314329 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application next(self.gen) Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application yield resource Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application next(self.gen) Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise self.value Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application session.commit() Oct 20 19:06:51.315456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self.session.flush() Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application compat.raise_( Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 19:06:51.317800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 19:06:51.318973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application conn.query(q) Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application result.read() Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 19:06:51.320231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [parameters: {'id': '609769e623454109a5e3a537fc23e03c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:51.321532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:51.322586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:51.324032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:51.324032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 20 19:06:51.324032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 20 19:06:51.324032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:51.324032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:51.324032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 19:06:51.324032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 19:06:51.324032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 609769e623454109a5e3a537fc23e03c. Oct 20 19:06:51.324032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:51.324032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 305/612] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Oct 20 19:06:51 2022] POST /identity/v3/projects => generated 262 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:51.326234 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10971b-3385-4ebf-b242-6c363f8b0848 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:51.421294 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10971b-3385-4ebf-b242-6c363f8b0848 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:51.454056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a350440-add3-40ee-b120-d4213ce2ca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:51.454678 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a350440-add3-40ee-b120-d4213ce2ca9e None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:51.454952 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a350440-add3-40ee-b120-d4213ce2ca9e None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:51.455217 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a350440-add3-40ee-b120-d4213ce2ca9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:51.462284 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a350440-add3-40ee-b120-d4213ce2ca9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:51.463702 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a350440-add3-40ee-b120-d4213ce2ca9e None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-9a350440-add3-40ee-b120-d4213ce2ca9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:06:51.475156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:51.476056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:51.477608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:06:51.477608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:06:51.477608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:06:51.477608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:06:51.477608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:06:51.477608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:06:51.477608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:06:51.477608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:51.477608 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 308/613] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:51.482294 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cae142-4b36-41cf-98a4-094b852aedaf None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:51.518618 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb7a62-573c-4a81-8cd3-623581cfbc22 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:51.518900 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb7a62-573c-4a81-8cd3-623581cfbc22 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:51.519173 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb7a62-573c-4a81-8cd3-623581cfbc22 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:51.521047 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 309/614] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:06:51.526173 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd942bf-6432-4f23-9226-f1d1bc39f840 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:51.526456 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd942bf-6432-4f23-9226-f1d1bc39f840 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:51.526723 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd942bf-6432-4f23-9226-f1d1bc39f840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:51.545273 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-6bd942bf-6432-4f23-9226-f1d1bc39f840 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:51.546466 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-6bd942bf-6432-4f23-9226-f1d1bc39f840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:51.563075 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:51.583315 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cae142-4b36-41cf-98a4-094b852aedaf None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:51.612840 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 310/615] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:51 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 19:06:51.616669 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe4f87-23e1-4798-999f-6cf3c7b2f105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:51.617273 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe4f87-23e1-4798-999f-6cf3c7b2f105 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:51.617545 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe4f87-23e1-4798-999f-6cf3c7b2f105 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:51.617810 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe4f87-23e1-4798-999f-6cf3c7b2f105 None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:51.618455 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe4f87-23e1-4798-999f-6cf3c7b2f105 None admin] RBAC: Adding query filter params (name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:51.618750 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe4f87-23e1-4798-999f-6cf3c7b2f105 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:51.620362 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe4f87-23e1-4798-999f-6cf3c7b2f105 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:51.644205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 306/616] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:51.937069 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd942bf-6432-4f23-9226-f1d1bc39f840 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:52.032541 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd942bf-6432-4f23-9226-f1d1bc39f840 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:52.065379 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a98a54-a0a0-4150-a2e1-f7a7904e5b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:52.066002 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98a54-a0a0-4150-a2e1-f7a7904e5b81 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:52.066280 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98a54-a0a0-4150-a2e1-f7a7904e5b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:52.067051 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98a54-a0a0-4150-a2e1-f7a7904e5b81 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:52.067641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a98a54-a0a0-4150-a2e1-f7a7904e5b81 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:52.069020 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a98a54-a0a0-4150-a2e1-f7a7904e5b81 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-19a98a54-a0a0-4150-a2e1-f7a7904e5b81 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:52.077652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:52.078844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:52.079691 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 311/617] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:52.085228 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe4f87-23e1-4798-999f-6cf3c7b2f105 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:52.130620 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:52.185340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe4f87-23e1-4798-999f-6cf3c7b2f105 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:52.218491 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5677-7ecf-43df-8e29-21c3ce9526c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:52.219098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5677-7ecf-43df-8e29-21c3ce9526c1 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:52.219375 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5677-7ecf-43df-8e29-21c3ce9526c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:52.219645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5677-7ecf-43df-8e29-21c3ce9526c1 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:52.220287 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f5677-7ecf-43df-8e29-21c3ce9526c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:52.220592 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f5677-7ecf-43df-8e29-21c3ce9526c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:52.221946 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f5677-7ecf-43df-8e29-21c3ce9526c1 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:52.226761 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 307/618] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:52.232551 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a98a54-a0a0-4150-a2e1-f7a7904e5b81 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:52.251878 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:52.331936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a98a54-a0a0-4150-a2e1-f7a7904e5b81 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:52.364515 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d8054-4b10-460e-a365-a5a3c431e63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:52.365097 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d8054-4b10-460e-a365-a5a3c431e63b None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:52.365368 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d8054-4b10-460e-a365-a5a3c431e63b None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:52.365635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d8054-4b10-460e-a365-a5a3c431e63b None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:52.366249 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d8054-4b10-460e-a365-a5a3c431e63b None admin] RBAC: Adding query filter params (type=compute) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:52.366547 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d8054-4b10-460e-a365-a5a3c431e63b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:52.367885 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d8054-4b10-460e-a365-a5a3c431e63b None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:52.372758 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 312/619] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:52.378688 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5677-7ecf-43df-8e29-21c3ce9526c1 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:52.476988 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5677-7ecf-43df-8e29-21c3ce9526c1 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:52.485657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:52.511079 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ed78b-8aaa-43d0-b9e7-2a3c15a50791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:52.511672 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ed78b-8aaa-43d0-b9e7-2a3c15a50791 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:52.511941 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ed78b-8aaa-43d0-b9e7-2a3c15a50791 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:52.512210 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ed78b-8aaa-43d0-b9e7-2a3c15a50791 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:52.512921 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ed78b-8aaa-43d0-b9e7-2a3c15a50791 None admin] RBAC: Adding query filter params (interface=public, service_id=cf910c302968453cac6c1d53c815aa32, region_id=RegionOne) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:52.513220 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ed78b-8aaa-43d0-b9e7-2a3c15a50791 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:52.514567 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ed78b-8aaa-43d0-b9e7-2a3c15a50791 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:52.519460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 308/620] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 19:06:52 2022] GET /identity/v3/endpoints?service_id=cf910c302968453cac6c1d53c815aa32&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:52.525305 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d8054-4b10-460e-a365-a5a3c431e63b None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:52.605762 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:52.624966 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d8054-4b10-460e-a365-a5a3c431e63b None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:52.656583 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61b9e7-eb32-46a1-99d3-92936e1b820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:52.657156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61b9e7-eb32-46a1-99d3-92936e1b820a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:52.657427 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61b9e7-eb32-46a1-99d3-92936e1b820a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:52.657693 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61b9e7-eb32-46a1-99d3-92936e1b820a None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:52.658285 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61b9e7-eb32-46a1-99d3-92936e1b820a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:52.659934 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61b9e7-eb32-46a1-99d3-92936e1b820a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:52.666689 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 313/621] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 19:06:52 2022] GET /identity/v3/services => generated 1728 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:06:54.157305 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975a9c5-63c3-459e-a77d-1bb3978b3fe1 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:54.157829 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975a9c5-63c3-459e-a77d-1bb3978b3fe1 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:54.157829 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975a9c5-63c3-459e-a77d-1bb3978b3fe1 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:54.159078 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 309/622] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:06:54.164943 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5542d-b161-46df-bd2c-1d0fd3aa9cb8 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:54.165349 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5542d-b161-46df-bd2c-1d0fd3aa9cb8 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:54.165489 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5542d-b161-46df-bd2c-1d0fd3aa9cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:54.184197 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-35f5542d-b161-46df-bd2c-1d0fd3aa9cb8 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:54.185403 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-35f5542d-b161-46df-bd2c-1d0fd3aa9cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:54.249305 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 314/623] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:54 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:06:54.574746 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975a9c5-63c3-459e-a77d-1bb3978b3fe1 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:54.679558 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975a9c5-63c3-459e-a77d-1bb3978b3fe1 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:54.716603 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5d7b-cca2-4475-bddb-c73d877fab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:54.717266 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5d7b-cca2-4475-bddb-c73d877fab54 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:54.717559 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5d7b-cca2-4475-bddb-c73d877fab54 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:54.717802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5d7b-cca2-4475-bddb-c73d877fab54 None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:54.718460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d5d7b-cca2-4475-bddb-c73d877fab54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:54.719868 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d5d7b-cca2-4475-bddb-c73d877fab54 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:54.736696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.sql.core [None req-972d5d7b-cca2-4475-bddb-c73d877fab54 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 19:06:54.736696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 20 19:06:54.736696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [parameters: {'user_id': '179706defd894cc593551e1b2c94fa97', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 20 19:06:54.736696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88307) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-972d5d7b-cca2-4475-bddb-c73d877fab54 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application conn.query(q) Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application result.read() Oct 20 19:06:54.744159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 19:06:54.745124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application next(self.gen) Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application yield resource Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application next(self.gen) Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise self.value Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application session.commit() Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 19:06:54.746914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self.session.flush() Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application compat.raise_( Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 19:06:54.748729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 19:06:54.755410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application conn.query(q) Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application result.read() Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 19:06:54.757363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [parameters: {'user_id': '179706defd894cc593551e1b2c94fa97', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:54.759373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 20 19:06:54.761260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 20 19:06:54.763446 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 20 19:06:54.763446 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 20 19:06:54.763446 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 19:06:54.763446 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 19:06:54.763446 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 20 19:06:54.763446 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:54.763446 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 310/624] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Oct 20 19:06:54 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:54.764384 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5542d-b161-46df-bd2c-1d0fd3aa9cb8 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:54.825739 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:54.851143 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5542d-b161-46df-bd2c-1d0fd3aa9cb8 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:54.885380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aab66d-17f5-4f59-9466-f846afa74c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:54.886005 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aab66d-17f5-4f59-9466-f846afa74c58 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:54.886282 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aab66d-17f5-4f59-9466-f846afa74c58 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:54.886549 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aab66d-17f5-4f59-9466-f846afa74c58 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:54.893438 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aab66d-17f5-4f59-9466-f846afa74c58 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:54.895016 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aab66d-17f5-4f59-9466-f846afa74c58 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-44aab66d-17f5-4f59-9466-f846afa74c58 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:06:54.906370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:54.908136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:54.909494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:54.909494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:54.909494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:06:54.909494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:06:54.909494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:06:54.909494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:06:54.909494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:06:54.909494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:06:54.909494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 19:06:54.909494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:06:54.909494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 315/625] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:06:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:54.913908 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5d7b-cca2-4475-bddb-c73d877fab54 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:54.949218 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:55.015278 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5d7b-cca2-4475-bddb-c73d877fab54 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:55.043984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8669eb-de62-4fe6-9ed7-230e4b520018 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:55.044523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8669eb-de62-4fe6-9ed7-230e4b520018 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:55.044800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8669eb-de62-4fe6-9ed7-230e4b520018 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:55.046139 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 316/626] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:06:55.048802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3eecc-9771-4605-9edc-0f0fbb600fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:55.049400 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3eecc-9771-4605-9edc-0f0fbb600fc9 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:55.049676 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3eecc-9771-4605-9edc-0f0fbb600fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:55.049947 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3eecc-9771-4605-9edc-0f0fbb600fc9 None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:55.050637 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3eecc-9771-4605-9edc-0f0fbb600fc9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:55.051011 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3eecc-9771-4605-9edc-0f0fbb600fc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:55.051271 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989376a-71fb-418e-8ae4-ae11db5dc95e None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:55.051553 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989376a-71fb-418e-8ae4-ae11db5dc95e None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:55.051819 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989376a-71fb-418e-8ae4-ae11db5dc95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:55.052759 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3eecc-9771-4605-9edc-0f0fbb600fc9 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:55.069911 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-7989376a-71fb-418e-8ae4-ae11db5dc95e None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:06:55.071071 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-7989376a-71fb-418e-8ae4-ae11db5dc95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:06:55.091586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 311/627] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Oct 20 19:06:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:55.141306 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 317/628] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:06:55 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 19:06:55.469155 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3eecc-9771-4605-9edc-0f0fbb600fc9 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:55.559394 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:55.568361 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3eecc-9771-4605-9edc-0f0fbb600fc9 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:55.601483 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c96da-2456-460f-851e-662ee118d6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:55.602088 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c96da-2456-460f-851e-662ee118d6ba None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:55.602361 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c96da-2456-460f-851e-662ee118d6ba None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:55.602626 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c96da-2456-460f-851e-662ee118d6ba None admin] PATH_INFO: `/v3/services/compute` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:55.603191 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c96da-2456-460f-851e-662ee118d6ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:55.604575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c96da-2456-460f-851e-662ee118d6ba None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-118c96da-2456-460f-851e-662ee118d6ba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:06:55.612926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:06:55.614627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:06:55.615632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 312/629] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:06:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:06:55.620488 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989376a-71fb-418e-8ae4-ae11db5dc95e None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:55.681318 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:55.718486 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989376a-71fb-418e-8ae4-ae11db5dc95e None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:55.751665 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67be7dc-7496-4d45-a805-f71ce4e973b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:55.752211 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67be7dc-7496-4d45-a805-f71ce4e973b5 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:55.752524 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67be7dc-7496-4d45-a805-f71ce4e973b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:55.752804 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67be7dc-7496-4d45-a805-f71ce4e973b5 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:55.753436 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67be7dc-7496-4d45-a805-f71ce4e973b5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:55.753727 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67be7dc-7496-4d45-a805-f71ce4e973b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:55.755113 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67be7dc-7496-4d45-a805-f71ce4e973b5 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:55.759946 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 318/630] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:55.766382 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c96da-2456-460f-851e-662ee118d6ba None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:55.864670 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c96da-2456-460f-851e-662ee118d6ba None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:55.896615 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94ca1a-6bbb-4011-a099-f13af924ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:55.897186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94ca1a-6bbb-4011-a099-f13af924ec51 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:55.897455 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94ca1a-6bbb-4011-a099-f13af924ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:55.897719 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94ca1a-6bbb-4011-a099-f13af924ec51 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:55.898328 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94ca1a-6bbb-4011-a099-f13af924ec51 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:06:55.898623 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94ca1a-6bbb-4011-a099-f13af924ec51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:55.899954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94ca1a-6bbb-4011-a099-f13af924ec51 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:55.904609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 313/631] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Oct 20 19:06:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:06:55.910799 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67be7dc-7496-4d45-a805-f71ce4e973b5 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:06:56.017567 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67be7dc-7496-4d45-a805-f71ce4e973b5 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:06:56.042318 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:06:56.049951 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07401d-5a39-4228-bb1c-b4121dda6911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:06:56.050543 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07401d-5a39-4228-bb1c-b4121dda6911 None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:06:56.051413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07401d-5a39-4228-bb1c-b4121dda6911 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:06:56.051781 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07401d-5a39-4228-bb1c-b4121dda6911 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:06:56.052473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07401d-5a39-4228-bb1c-b4121dda6911 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:06:56.053801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07401d-5a39-4228-bb1c-b4121dda6911 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:06:56.072377 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 319/632] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:06:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 19:07:05.902658 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=90 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:07:06.068471 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=7,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:07:58.882444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa401c-8894-447e-94ed-a8b7ba80ecb3 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:07:58.883061 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa401c-8894-447e-94ed-a8b7ba80ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:07:58.883061 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa401c-8894-447e-94ed-a8b7ba80ecb3 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:07:58.884718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 314/633] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:07:58.890362 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cbed5-75cc-404c-b2b5-fb92624a253b None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:07:58.890825 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cbed5-75cc-404c-b2b5-fb92624a253b None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:07:58.890981 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cbed5-75cc-404c-b2b5-fb92624a253b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:07:58.911363 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-802cbed5-75cc-404c-b2b5-fb92624a253b None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:07:58.912575 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-802cbed5-75cc-404c-b2b5-fb92624a253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:07:58.997720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 320/634] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:07:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:07:59.336195 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa401c-8894-447e-94ed-a8b7ba80ecb3 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:07:59.470195 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa401c-8894-447e-94ed-a8b7ba80ecb3 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:07:59.512794 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eecfe1-e3a4-49e4-a788-6b03646f6783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:07:59.513435 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eecfe1-e3a4-49e4-a788-6b03646f6783 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:07:59.513755 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eecfe1-e3a4-49e4-a788-6b03646f6783 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:07:59.514036 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eecfe1-e3a4-49e4-a788-6b03646f6783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:07:59.526790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eecfe1-e3a4-49e4-a788-6b03646f6783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:07:59.528404 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eecfe1-e3a4-49e4-a788-6b03646f6783 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-37eecfe1-e3a4-49e4-a788-6b03646f6783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:07:59.546692 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:07:59.547976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:07:59.549238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:07:59.549238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:07:59.549238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:07:59.549238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 315/635] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:07:59.553783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cbed5-75cc-404c-b2b5-fb92624a253b None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:07:59.680709 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cbed5-75cc-404c-b2b5-fb92624a253b None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:07:59.716165 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:07:59.728612 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5aa0f-d9ae-4aff-b8b4-31a622c45db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:07:59.729322 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5aa0f-d9ae-4aff-b8b4-31a622c45db7 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:07:59.729626 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5aa0f-d9ae-4aff-b8b4-31a622c45db7 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:07:59.729922 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5aa0f-d9ae-4aff-b8b4-31a622c45db7 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:07:59.730822 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5aa0f-d9ae-4aff-b8b4-31a622c45db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:07:59.731096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5aa0f-d9ae-4aff-b8b4-31a622c45db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:07:59.732714 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5aa0f-d9ae-4aff-b8b4-31a622c45db7 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:07:59.747072 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 321/636] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:07:59.753098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eecfe1-e3a4-49e4-a788-6b03646f6783 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:07:59.825919 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:07:59.889084 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eecfe1-e3a4-49e4-a788-6b03646f6783 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:07:59.933065 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee5971-56bc-4e80-a14c-4967d883b8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:07:59.933622 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5971-56bc-4e80-a14c-4967d883b8c3 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:07:59.933912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5971-56bc-4e80-a14c-4967d883b8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:07:59.934198 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee5971-56bc-4e80-a14c-4967d883b8c3 None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:07:59.934899 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee5971-56bc-4e80-a14c-4967d883b8c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:07:59.936416 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee5971-56bc-4e80-a14c-4967d883b8c3 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:07:59.958587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 316/637] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Oct 20 19:07:59 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 19:08:02.541701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6e794-4835-4277-bc78-567fc730aac1 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:02.542273 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6e794-4835-4277-bc78-567fc730aac1 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:02.542273 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6e794-4835-4277-bc78-567fc730aac1 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:02.543920 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 322/638] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:08:02.549829 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004463-f1c8-4028-9e65-098730eb07fe None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:02.550298 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004463-f1c8-4028-9e65-098730eb07fe None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:02.550432 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004463-f1c8-4028-9e65-098730eb07fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:02.569663 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-ab004463-f1c8-4028-9e65-098730eb07fe None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:08:02.571166 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-ab004463-f1c8-4028-9e65-098730eb07fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:08:02.640732 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 317/639] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:08:02 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:08:02.980792 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6e794-4835-4277-bc78-567fc730aac1 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:03.091798 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6e794-4835-4277-bc78-567fc730aac1 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:03.130813 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da868de-f3ba-4031-b32b-843299968ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:03.131443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da868de-f3ba-4031-b32b-843299968ce7 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:03.131733 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da868de-f3ba-4031-b32b-843299968ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:03.131991 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da868de-f3ba-4031-b32b-843299968ce7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:03.143563 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da868de-f3ba-4031-b32b-843299968ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-5da868de-f3ba-4031-b32b-843299968ce7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:08:03.148643 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:03.149879 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:08:03.150918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:03.154953 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 323/640] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:03.156021 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab004463-f1c8-4028-9e65-098730eb07fe None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:03.196945 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:03.262006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab004463-f1c8-4028-9e65-098730eb07fe None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:03.299151 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfe30f-120a-48c6-8534-a5216e5f88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:03.300101 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfe30f-120a-48c6-8534-a5216e5f88ce None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:03.300410 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfe30f-120a-48c6-8534-a5216e5f88ce None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:03.300677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfe30f-120a-48c6-8534-a5216e5f88ce None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:03.301435 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfe30f-120a-48c6-8534-a5216e5f88ce None admin] RBAC: Adding query filter params (name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:03.301775 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfe30f-120a-48c6-8534-a5216e5f88ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:03.303760 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfe30f-120a-48c6-8534-a5216e5f88ce None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:03.313699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 318/641] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 19:08:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:03.319967 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da868de-f3ba-4031-b32b-843299968ce7 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:03.375224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:03.440507 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da868de-f3ba-4031-b32b-843299968ce7 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:03.481417 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33415419-c9c3-4bde-bbf0-6c21cb77b760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:03.482066 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33415419-c9c3-4bde-bbf0-6c21cb77b760 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:03.482329 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33415419-c9c3-4bde-bbf0-6c21cb77b760 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:03.482670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33415419-c9c3-4bde-bbf0-6c21cb77b760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:03.493978 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33415419-c9c3-4bde-bbf0-6c21cb77b760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:03.495459 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33415419-c9c3-4bde-bbf0-6c21cb77b760 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-33415419-c9c3-4bde-bbf0-6c21cb77b760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:08:03.514503 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:03.515639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:08:03.517494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:08:03.517494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:03.517494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:03.517494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 324/642] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:03.522043 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfe30f-120a-48c6-8534-a5216e5f88ce None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:03.629512 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:03.632908 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfe30f-120a-48c6-8534-a5216e5f88ce None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:03.673170 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9db52-8fbb-489f-918f-d7b2ee452ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:03.673991 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9db52-8fbb-489f-918f-d7b2ee452ea4 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:03.674299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9db52-8fbb-489f-918f-d7b2ee452ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:03.674575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9db52-8fbb-489f-918f-d7b2ee452ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:03.675361 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9db52-8fbb-489f-918f-d7b2ee452ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:03.675662 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9db52-8fbb-489f-918f-d7b2ee452ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:03.677349 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9db52-8fbb-489f-918f-d7b2ee452ea4 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:03.692328 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 319/643] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:03.697150 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33415419-c9c3-4bde-bbf0-6c21cb77b760 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:03.804147 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:03.807798 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33415419-c9c3-4bde-bbf0-6c21cb77b760 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:03.843281 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202d1a3-f4e0-4da2-97e9-29cfc16cfc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:03.843949 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202d1a3-f4e0-4da2-97e9-29cfc16cfc62 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:03.844228 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202d1a3-f4e0-4da2-97e9-29cfc16cfc62 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:03.845044 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202d1a3-f4e0-4da2-97e9-29cfc16cfc62 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:03.853290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202d1a3-f4e0-4da2-97e9-29cfc16cfc62 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:03.854779 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202d1a3-f4e0-4da2-97e9-29cfc16cfc62 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-e202d1a3-f4e0-4da2-97e9-29cfc16cfc62 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:08:03.866290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:03.867292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:03.868239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:03.868239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:03.868239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:08:03.868239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:08:03.868239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:08:03.868239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:08:03.868239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:08:03.868239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:08:03.868239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 19:08:03.868239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:03.868239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 325/644] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:03.873660 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9db52-8fbb-489f-918f-d7b2ee452ea4 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:03.988815 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9db52-8fbb-489f-918f-d7b2ee452ea4 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:04.024997 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06bd00-99cd-43ca-a9be-9e2c2e11150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:04.025605 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06bd00-99cd-43ca-a9be-9e2c2e11150e None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:04.025888 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06bd00-99cd-43ca-a9be-9e2c2e11150e None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:04.026161 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06bd00-99cd-43ca-a9be-9e2c2e11150e None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:04.026908 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06bd00-99cd-43ca-a9be-9e2c2e11150e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:04.027212 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06bd00-99cd-43ca-a9be-9e2c2e11150e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:04.028710 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06bd00-99cd-43ca-a9be-9e2c2e11150e None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:04.049927 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 320/645] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Oct 20 19:08:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:04.055889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202d1a3-f4e0-4da2-97e9-29cfc16cfc62 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:04.162337 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202d1a3-f4e0-4da2-97e9-29cfc16cfc62 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:04.199994 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37db7f2-73a7-444f-a8a8-316f9a0efdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:04.200798 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37db7f2-73a7-444f-a8a8-316f9a0efdb2 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:04.201085 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37db7f2-73a7-444f-a8a8-316f9a0efdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:04.201387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37db7f2-73a7-444f-a8a8-316f9a0efdb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:04.214262 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37db7f2-73a7-444f-a8a8-316f9a0efdb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:04.215770 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37db7f2-73a7-444f-a8a8-316f9a0efdb2 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-b37db7f2-73a7-444f-a8a8-316f9a0efdb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:08:04.231298 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:04.232442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:08:04.233817 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:08:04.233817 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:04.233817 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:04.237542 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 326/646] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:04.238743 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06bd00-99cd-43ca-a9be-9e2c2e11150e None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:04.257609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:04.347518 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06bd00-99cd-43ca-a9be-9e2c2e11150e None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:04.389489 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2006e1-a0e7-4ae7-a4ba-a31024a3832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:04.390100 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2006e1-a0e7-4ae7-a4ba-a31024a3832c None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:04.390376 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2006e1-a0e7-4ae7-a4ba-a31024a3832c None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:04.390660 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2006e1-a0e7-4ae7-a4ba-a31024a3832c None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:04.391801 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2006e1-a0e7-4ae7-a4ba-a31024a3832c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:04.392103 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2006e1-a0e7-4ae7-a4ba-a31024a3832c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:04.393524 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2006e1-a0e7-4ae7-a4ba-a31024a3832c None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:04.408339 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 321/647] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:04.414545 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37db7f2-73a7-444f-a8a8-316f9a0efdb2 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:04.428109 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:04.523907 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37db7f2-73a7-444f-a8a8-316f9a0efdb2 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:04.559904 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ae0ea-cd2d-4975-8b3c-5aadeefcd8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:04.560562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae0ea-cd2d-4975-8b3c-5aadeefcd8ed None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:04.560949 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae0ea-cd2d-4975-8b3c-5aadeefcd8ed None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:04.561235 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae0ea-cd2d-4975-8b3c-5aadeefcd8ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:04.569121 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ae0ea-cd2d-4975-8b3c-5aadeefcd8ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:04.570582 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ae0ea-cd2d-4975-8b3c-5aadeefcd8ed None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-603ae0ea-cd2d-4975-8b3c-5aadeefcd8ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:08:04.582847 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:04.584019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:04.585498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:08:04.585498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:08:04.585498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:08:04.585498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:08:04.585498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:08:04.585498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:08:04.585498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:08:04.585498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:04.590403 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 327/648] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:04.590537 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2006e1-a0e7-4ae7-a4ba-a31024a3832c None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:04.674639 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:04.701530 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2006e1-a0e7-4ae7-a4ba-a31024a3832c None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:04.740258 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87841218-2344-4da8-b47d-b6e4cf3c877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:04.740889 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841218-2344-4da8-b47d-b6e4cf3c877e None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:04.741166 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841218-2344-4da8-b47d-b6e4cf3c877e None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:04.741434 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841218-2344-4da8-b47d-b6e4cf3c877e None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:04.742126 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87841218-2344-4da8-b47d-b6e4cf3c877e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:04.742420 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87841218-2344-4da8-b47d-b6e4cf3c877e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:04.743852 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87841218-2344-4da8-b47d-b6e4cf3c877e None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:04.756942 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 322/649] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:04.763530 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ae0ea-cd2d-4975-8b3c-5aadeefcd8ed None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:04.837617 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:04.872137 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ae0ea-cd2d-4975-8b3c-5aadeefcd8ed None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:04.908910 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fb73f-a7d0-440b-93b9-e1d5aea0d71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:04.909564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb73f-a7d0-440b-93b9-e1d5aea0d71b None admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:04.909843 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb73f-a7d0-440b-93b9-e1d5aea0d71b None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:04.910134 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb73f-a7d0-440b-93b9-e1d5aea0d71b None admin] PATH_INFO: `/v3/projects/75fce313b5e242adb9eb825bc017e358/users/43fc68da6f184762a5e7312ce37f4988/roles/88986c4f59104ec0b79504be9dc10243` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:04.926845 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fb73f-a7d0-440b-93b9-e1d5aea0d71b None admin] RBAC: Authorizing `identity:create_grant(project_id=75fce313b5e242adb9eb825bc017e358, user_id=43fc68da6f184762a5e7312ce37f4988, role_id=88986c4f59104ec0b79504be9dc10243)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:04.928207 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fb73f-a7d0-440b-93b9-e1d5aea0d71b None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:04.941908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 328/650] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:08:04 2022] PUT /identity/v3/projects/75fce313b5e242adb9eb825bc017e358/users/43fc68da6f184762a5e7312ce37f4988/roles/88986c4f59104ec0b79504be9dc10243 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:08:07.743220 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa9ae9-fa91-4cb0-84fc-afc0dbd9a48b None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:07.743759 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa9ae9-fa91-4cb0-84fc-afc0dbd9a48b None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:07.743945 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa9ae9-fa91-4cb0-84fc-afc0dbd9a48b None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:07.745749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 323/651] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:08:07.752255 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460361f8-dc38-4758-afd3-a9c05ce4a20f None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:07.753555 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460361f8-dc38-4758-afd3-a9c05ce4a20f None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:07.753555 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460361f8-dc38-4758-afd3-a9c05ce4a20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:07.773394 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-460361f8-dc38-4758-afd3-a9c05ce4a20f None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:08:07.774912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-460361f8-dc38-4758-afd3-a9c05ce4a20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:08:07.849908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 329/652] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:08:07 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:08:08.184104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa9ae9-fa91-4cb0-84fc-afc0dbd9a48b None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:08.294992 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa9ae9-fa91-4cb0-84fc-afc0dbd9a48b None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:08.330675 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4c153-ae28-4788-95ee-d2e7216b07b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:08.331444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c153-ae28-4788-95ee-d2e7216b07b4 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:08.331767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c153-ae28-4788-95ee-d2e7216b07b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:08.332038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c153-ae28-4788-95ee-d2e7216b07b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:08.342837 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:08.348064 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4c153-ae28-4788-95ee-d2e7216b07b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-a6d4c153-ae28-4788-95ee-d2e7216b07b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:08:08.352870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:08.354040 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:08:08.355418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 324/653] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Oct 20 19:08:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:08:08.361142 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460361f8-dc38-4758-afd3-a9c05ce4a20f None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:08.416932 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:08.471955 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460361f8-dc38-4758-afd3-a9c05ce4a20f None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:08.510710 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbe2c1-9210-4897-95fe-f6bef396a478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:08.511372 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbe2c1-9210-4897-95fe-f6bef396a478 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:08.511759 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbe2c1-9210-4897-95fe-f6bef396a478 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:08.512085 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbe2c1-9210-4897-95fe-f6bef396a478 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:08.512873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbe2c1-9210-4897-95fe-f6bef396a478 None admin] RBAC: Adding query filter params (name=service) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:08.513287 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbe2c1-9210-4897-95fe-f6bef396a478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:08.515097 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbe2c1-9210-4897-95fe-f6bef396a478 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:08.524905 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 330/654] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Oct 20 19:08:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:08.530829 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4c153-ae28-4788-95ee-d2e7216b07b4 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:08.643727 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4c153-ae28-4788-95ee-d2e7216b07b4 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:08.680635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52980fd-94bc-4429-b19c-869e6c17db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:08.681297 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52980fd-94bc-4429-b19c-869e6c17db69 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:08.681534 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52980fd-94bc-4429-b19c-869e6c17db69 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:08.681800 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52980fd-94bc-4429-b19c-869e6c17db69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:08.694600 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52980fd-94bc-4429-b19c-869e6c17db69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:08.696131 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52980fd-94bc-4429-b19c-869e6c17db69 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-a52980fd-94bc-4429-b19c-869e6c17db69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:08:08.713468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:08.714664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:08:08.715812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:08:08.715812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:08.715812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:08:08.715812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 325/655] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:08.722085 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbe2c1-9210-4897-95fe-f6bef396a478 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:08.825129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbe2c1-9210-4897-95fe-f6bef396a478 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:08.839463 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:08.862954 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449df208-b6c4-4245-a60e-977b765bd8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:08.863551 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449df208-b6c4-4245-a60e-977b765bd8ce None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:08.863826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449df208-b6c4-4245-a60e-977b765bd8ce None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:08.864091 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449df208-b6c4-4245-a60e-977b765bd8ce None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:08.864805 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449df208-b6c4-4245-a60e-977b765bd8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:08.865105 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449df208-b6c4-4245-a60e-977b765bd8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:08.866649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449df208-b6c4-4245-a60e-977b765bd8ce None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:08.879690 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 331/656] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:08:08.885290 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52980fd-94bc-4429-b19c-869e6c17db69 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:08.939156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:08.993159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52980fd-94bc-4429-b19c-869e6c17db69 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:09.030403 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cd1d3-b89f-44f2-903d-9eadb8d75057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:09.031024 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd1d3-b89f-44f2-903d-9eadb8d75057 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:09.031367 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd1d3-b89f-44f2-903d-9eadb8d75057 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:09.031616 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd1d3-b89f-44f2-903d-9eadb8d75057 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:09.040332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cd1d3-b89f-44f2-903d-9eadb8d75057 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:09.041998 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cd1d3-b89f-44f2-903d-9eadb8d75057 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-636cd1d3-b89f-44f2-903d-9eadb8d75057 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:08:09.054444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:09.055609 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:09.056767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:09.056767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:09.056767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:08:09.056767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:08:09.056767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:08:09.056767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:08:09.056767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:08:09.056767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:08:09.056767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 19:08:09.056767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:08:09.056767 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 326/657] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:09.061791 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449df208-b6c4-4245-a60e-977b765bd8ce None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:09.175246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449df208-b6c4-4245-a60e-977b765bd8ce None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:09.214222 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7766a7-5aed-4bcb-bd7a-32d657e87926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:09.214892 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7766a7-5aed-4bcb-bd7a-32d657e87926 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:09.215168 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7766a7-5aed-4bcb-bd7a-32d657e87926 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:09.215436 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7766a7-5aed-4bcb-bd7a-32d657e87926 None admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:09.216161 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7766a7-5aed-4bcb-bd7a-32d657e87926 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:09.216553 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7766a7-5aed-4bcb-bd7a-32d657e87926 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:09.218137 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7766a7-5aed-4bcb-bd7a-32d657e87926 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:09.237315 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 332/658] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Oct 20 19:08:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:08:09.243408 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cd1d3-b89f-44f2-903d-9eadb8d75057 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:09.351834 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cd1d3-b89f-44f2-903d-9eadb8d75057 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:09.362588 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:09.397117 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93ba7f-2b2f-493d-8bcd-099822651813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:09.397720 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93ba7f-2b2f-493d-8bcd-099822651813 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:09.397995 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93ba7f-2b2f-493d-8bcd-099822651813 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:09.398501 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93ba7f-2b2f-493d-8bcd-099822651813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:09.472478 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93ba7f-2b2f-493d-8bcd-099822651813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:09.473930 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93ba7f-2b2f-493d-8bcd-099822651813 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:09.578177 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 327/659] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:08:09 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 19:08:09.584738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7766a7-5aed-4bcb-bd7a-32d657e87926 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:09.616287 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:09.693533 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7766a7-5aed-4bcb-bd7a-32d657e87926 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:09.727813 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc20849-5a33-45fe-8683-3af755decac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:09.728467 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc20849-5a33-45fe-8683-3af755decac2 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:09.728745 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc20849-5a33-45fe-8683-3af755decac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:09.729047 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc20849-5a33-45fe-8683-3af755decac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:09.740536 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc20849-5a33-45fe-8683-3af755decac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:09.742494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc20849-5a33-45fe-8683-3af755decac2 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-dfc20849-5a33-45fe-8683-3af755decac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:08:09.758309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:09.764053 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:08:09.765016 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:08:09.765016 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:09.765016 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:09.765016 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 333/660] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:09.765249 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93ba7f-2b2f-493d-8bcd-099822651813 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:09.778167 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:09.872718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93ba7f-2b2f-493d-8bcd-099822651813 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:09.908566 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40420394-0b0e-4911-9858-2c39528a1aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:09.909247 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40420394-0b0e-4911-9858-2c39528a1aaa None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:09.909459 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40420394-0b0e-4911-9858-2c39528a1aaa None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:09.909769 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40420394-0b0e-4911-9858-2c39528a1aaa None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:09.910483 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40420394-0b0e-4911-9858-2c39528a1aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:09.910813 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40420394-0b0e-4911-9858-2c39528a1aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:09.912344 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40420394-0b0e-4911-9858-2c39528a1aaa None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:09.925662 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 328/661] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:08:09.931500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc20849-5a33-45fe-8683-3af755decac2 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:10.015696 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:10.039987 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc20849-5a33-45fe-8683-3af755decac2 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:10.074289 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415879f-eda9-4d3c-b367-426cf8f800dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:10.074918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415879f-eda9-4d3c-b367-426cf8f800dc None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:10.075192 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415879f-eda9-4d3c-b367-426cf8f800dc None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:10.075460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415879f-eda9-4d3c-b367-426cf8f800dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:10.083114 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415879f-eda9-4d3c-b367-426cf8f800dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:10.084586 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415879f-eda9-4d3c-b367-426cf8f800dc None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-e415879f-eda9-4d3c-b367-426cf8f800dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:08:10.096370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:10.097366 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:10.098562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:08:10.098562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:08:10.098562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:08:10.098562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:08:10.098562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:08:10.098562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:08:10.098562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:08:10.098562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:10.098562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 334/662] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:08:10.103476 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40420394-0b0e-4911-9858-2c39528a1aaa None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:10.183829 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:10.216970 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40420394-0b0e-4911-9858-2c39528a1aaa None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:10.251906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae9d3b-7d8f-4778-b985-385f93090816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:10.252544 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae9d3b-7d8f-4778-b985-385f93090816 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:10.252828 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae9d3b-7d8f-4778-b985-385f93090816 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:10.253099 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae9d3b-7d8f-4778-b985-385f93090816 None admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:10.253785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae9d3b-7d8f-4778-b985-385f93090816 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:10.254091 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae9d3b-7d8f-4778-b985-385f93090816 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:10.255518 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae9d3b-7d8f-4778-b985-385f93090816 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:10.267723 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 329/663] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:10.273813 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415879f-eda9-4d3c-b367-426cf8f800dc None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:10.383428 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415879f-eda9-4d3c-b367-426cf8f800dc None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:10.421238 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bf304-37b2-4985-8ee9-274cf4400264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:10.421899 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bf304-37b2-4985-8ee9-274cf4400264 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:10.422786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bf304-37b2-4985-8ee9-274cf4400264 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:10.423101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bf304-37b2-4985-8ee9-274cf4400264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:10.423935 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bf304-37b2-4985-8ee9-274cf4400264 None admin] RBAC: Adding query filter params (role.id=88986c4f59104ec0b79504be9dc10243, scope.project.id=75fce313b5e242adb9eb825bc017e358, user.id=43fc68da6f184762a5e7312ce37f4988) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:10.424256 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bf304-37b2-4985-8ee9-274cf4400264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:10.425685 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bf304-37b2-4985-8ee9-274cf4400264 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:10.432433 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 335/664] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:08:10 2022] GET /identity/v3/role_assignments?user.id=43fc68da6f184762a5e7312ce37f4988&scope.project.id=75fce313b5e242adb9eb825bc017e358&role.id=88986c4f59104ec0b79504be9dc10243 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:12.858872 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4de7-8ac3-4a5a-95fa-3ffc78bde868 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:12.859959 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4de7-8ac3-4a5a-95fa-3ffc78bde868 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:12.859959 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4de7-8ac3-4a5a-95fa-3ffc78bde868 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:12.861655 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 330/665] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:08:12.867433 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1cd99-ab4f-422c-a3fe-4e193aa17c2d None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:12.867900 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1cd99-ab4f-422c-a3fe-4e193aa17c2d None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:12.868379 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1cd99-ab4f-422c-a3fe-4e193aa17c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:12.886035 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:12.892359 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-adc1cd99-ab4f-422c-a3fe-4e193aa17c2d None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:08:12.893547 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-adc1cd99-ab4f-422c-a3fe-4e193aa17c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:08:12.972635 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 336/666] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:08:12 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:08:13.301478 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4de7-8ac3-4a5a-95fa-3ffc78bde868 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:13.418526 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4de7-8ac3-4a5a-95fa-3ffc78bde868 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:13.453914 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:13.460545 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a780b39-ff3b-4ae5-8d37-cbbc47bf9135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:13.461165 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a780b39-ff3b-4ae5-8d37-cbbc47bf9135 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:13.461435 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a780b39-ff3b-4ae5-8d37-cbbc47bf9135 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:13.461722 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a780b39-ff3b-4ae5-8d37-cbbc47bf9135 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:13.472886 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a780b39-ff3b-4ae5-8d37-cbbc47bf9135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-2a780b39-ff3b-4ae5-8d37-cbbc47bf9135 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:08:13.477628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:13.478630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:08:13.479503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 331/667] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 19:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:13.485323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1cd99-ab4f-422c-a3fe-4e193aa17c2d None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:13.602340 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1cd99-ab4f-422c-a3fe-4e193aa17c2d None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:13.643812 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cf912-7387-4fb3-8e2b-2072f726fdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:13.644572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cf912-7387-4fb3-8e2b-2072f726fdc4 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:13.644854 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cf912-7387-4fb3-8e2b-2072f726fdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:13.645163 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cf912-7387-4fb3-8e2b-2072f726fdc4 None admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:13.645905 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cf912-7387-4fb3-8e2b-2072f726fdc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:13.646255 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cf912-7387-4fb3-8e2b-2072f726fdc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:13.647757 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cf912-7387-4fb3-8e2b-2072f726fdc4 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:13.650328 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:13.662644 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 337/668] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:08:13.663414 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a780b39-ff3b-4ae5-8d37-cbbc47bf9135 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:13.792142 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a780b39-ff3b-4ae5-8d37-cbbc47bf9135 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:13.828593 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55133aec-245b-4471-b65b-f09a4e914e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:13.829462 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55133aec-245b-4471-b65b-f09a4e914e9e None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:13.829731 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55133aec-245b-4471-b65b-f09a4e914e9e None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:13.830015 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55133aec-245b-4471-b65b-f09a4e914e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:13.840144 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55133aec-245b-4471-b65b-f09a4e914e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:13.841583 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55133aec-245b-4471-b65b-f09a4e914e9e None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-55133aec-245b-4471-b65b-f09a4e914e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:08:13.856712 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:13.857851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:08:13.858873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:08:13.858873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:13.858873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:08:13.858873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 332/669] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:08:13.865090 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cf912-7387-4fb3-8e2b-2072f726fdc4 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:13.971973 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cf912-7387-4fb3-8e2b-2072f726fdc4 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:14.010244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442ba90-1983-48c2-919f-e4ceabf57d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:14.011163 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442ba90-1983-48c2-919f-e4ceabf57d68 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:14.011569 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442ba90-1983-48c2-919f-e4ceabf57d68 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:14.011941 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442ba90-1983-48c2-919f-e4ceabf57d68 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:14.012725 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442ba90-1983-48c2-919f-e4ceabf57d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:14.013073 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442ba90-1983-48c2-919f-e4ceabf57d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:14.014700 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442ba90-1983-48c2-919f-e4ceabf57d68 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:14.028338 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 338/670] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:14.035814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55133aec-245b-4471-b65b-f09a4e914e9e None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:14.091268 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:14.154460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55133aec-245b-4471-b65b-f09a4e914e9e None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:14.192971 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ba90c-d22c-47b7-a5b1-f16c5425a79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:14.193607 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ba90c-d22c-47b7-a5b1-f16c5425a79a None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:14.194079 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ba90c-d22c-47b7-a5b1-f16c5425a79a None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:14.194366 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ba90c-d22c-47b7-a5b1-f16c5425a79a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:14.206428 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ba90c-d22c-47b7-a5b1-f16c5425a79a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:14.207940 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ba90c-d22c-47b7-a5b1-f16c5425a79a None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-c30ba90c-d22c-47b7-a5b1-f16c5425a79a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:08:14.221277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:14.222878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:14.224055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:14.224055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:14.224055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:08:14.224055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:08:14.224055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:08:14.224055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:08:14.224055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:08:14.224055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:08:14.224055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 19:08:14.224055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:08:14.224055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 333/671] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:08:14.228475 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442ba90-1983-48c2-919f-e4ceabf57d68 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:14.297310 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:14.342854 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442ba90-1983-48c2-919f-e4ceabf57d68 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:14.383258 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706454c2-0d7d-4359-aace-3bac23c40ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:14.383901 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706454c2-0d7d-4359-aace-3bac23c40ad2 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:14.384172 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706454c2-0d7d-4359-aace-3bac23c40ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:14.384469 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706454c2-0d7d-4359-aace-3bac23c40ad2 None admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:14.385198 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706454c2-0d7d-4359-aace-3bac23c40ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:14.385498 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706454c2-0d7d-4359-aace-3bac23c40ad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:14.386936 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706454c2-0d7d-4359-aace-3bac23c40ad2 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:14.406186 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 339/672] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Oct 20 19:08:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:14.411906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ba90c-d22c-47b7-a5b1-f16c5425a79a None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:14.522635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ba90c-d22c-47b7-a5b1-f16c5425a79a None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:14.524179 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:14.559776 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12ecec-8f23-41a4-aa1a-1338bdee60b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:14.560438 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12ecec-8f23-41a4-aa1a-1338bdee60b4 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:14.560711 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12ecec-8f23-41a4-aa1a-1338bdee60b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:14.560972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12ecec-8f23-41a4-aa1a-1338bdee60b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:14.571898 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12ecec-8f23-41a4-aa1a-1338bdee60b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:14.573677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12ecec-8f23-41a4-aa1a-1338bdee60b4 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-6f12ecec-8f23-41a4-aa1a-1338bdee60b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:08:14.592587 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:14.599020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:08:14.600128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:08:14.600128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:14.600128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:08:14.600128 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 334/673] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 19:08:14.600456 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706454c2-0d7d-4359-aace-3bac23c40ad2 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:14.715207 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706454c2-0d7d-4359-aace-3bac23c40ad2 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:14.733910 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:14.753581 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206addb-b794-4728-8032-566792562b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:14.754337 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206addb-b794-4728-8032-566792562b92 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:14.754695 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206addb-b794-4728-8032-566792562b92 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:14.755078 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206addb-b794-4728-8032-566792562b92 None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:14.755962 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206addb-b794-4728-8032-566792562b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:14.756356 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206addb-b794-4728-8032-566792562b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:14.758100 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206addb-b794-4728-8032-566792562b92 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:14.771204 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 340/674] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:08:14.777030 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12ecec-8f23-41a4-aa1a-1338bdee60b4 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:14.893898 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12ecec-8f23-41a4-aa1a-1338bdee60b4 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:14.929840 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e344-32bd-4f31-9bf5-c53e5aa7e3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:14.930502 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e344-32bd-4f31-9bf5-c53e5aa7e3d1 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:14.930759 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e344-32bd-4f31-9bf5-c53e5aa7e3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:14.931027 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e344-32bd-4f31-9bf5-c53e5aa7e3d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:14.938343 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667e344-32bd-4f31-9bf5-c53e5aa7e3d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:14.939880 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667e344-32bd-4f31-9bf5-c53e5aa7e3d1 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-9667e344-32bd-4f31-9bf5-c53e5aa7e3d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:08:14.955080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:14.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:14.957271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:08:14.957271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:08:14.957271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:08:14.957271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:08:14.957271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:08:14.957271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:08:14.957271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:08:14.957271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:08:14.957271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 335/675] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:08:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:14.962583 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206addb-b794-4728-8032-566792562b92 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:15.079646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206addb-b794-4728-8032-566792562b92 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:15.119527 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031adb2-3174-4579-b489-59328c0b1e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:15.120234 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031adb2-3174-4579-b489-59328c0b1e70 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:15.120561 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031adb2-3174-4579-b489-59328c0b1e70 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:15.120846 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031adb2-3174-4579-b489-59328c0b1e70 None admin] PATH_INFO: `/v3/projects` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:15.121584 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031adb2-3174-4579-b489-59328c0b1e70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:15.121918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031adb2-3174-4579-b489-59328c0b1e70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:15.123494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031adb2-3174-4579-b489-59328c0b1e70 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:15.137256 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 341/676] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:15.144255 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e344-32bd-4f31-9bf5-c53e5aa7e3d1 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:15.161638 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:15.263041 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e344-32bd-4f31-9bf5-c53e5aa7e3d1 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:15.301159 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db8a4c-74c6-4fda-b6ba-4d8d2c92e421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:15.301823 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db8a4c-74c6-4fda-b6ba-4d8d2c92e421 None admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:15.302103 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db8a4c-74c6-4fda-b6ba-4d8d2c92e421 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:15.302375 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db8a4c-74c6-4fda-b6ba-4d8d2c92e421 None admin] PATH_INFO: `/v3/projects/75fce313b5e242adb9eb825bc017e358/users/43fc68da6f184762a5e7312ce37f4988/roles/fde247f30afe4b81958b67c776cabec0` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:15.304551 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db8a4c-74c6-4fda-b6ba-4d8d2c92e421 None admin] RBAC: Authorizing `identity:create_grant(project_id=75fce313b5e242adb9eb825bc017e358, user_id=43fc68da6f184762a5e7312ce37f4988, role_id=fde247f30afe4b81958b67c776cabec0)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:15.306173 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db8a4c-74c6-4fda-b6ba-4d8d2c92e421 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:15.320461 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 336/677] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Oct 20 19:08:15 2022] PUT /identity/v3/projects/75fce313b5e242adb9eb825bc017e358/users/43fc68da6f184762a5e7312ce37f4988/roles/fde247f30afe4b81958b67c776cabec0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:08:17.859684 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9ae5-4952-4391-b21c-23f58be56462 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:17.860205 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9ae5-4952-4391-b21c-23f58be56462 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:17.860205 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9ae5-4952-4391-b21c-23f58be56462 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:17.861543 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 342/678] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:08:17.866572 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369b303-2f09-4e9a-81cf-433b06bedcf4 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:17.866995 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369b303-2f09-4e9a-81cf-433b06bedcf4 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:17.867109 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369b303-2f09-4e9a-81cf-433b06bedcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:17.885234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-b369b303-2f09-4e9a-81cf-433b06bedcf4 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:08:17.886381 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-b369b303-2f09-4e9a-81cf-433b06bedcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:08:17.949891 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 337/679] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:08:17 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:08:18.267536 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b9ae5-4952-4391-b21c-23f58be56462 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:18.302607 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:18.367145 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b9ae5-4952-4391-b21c-23f58be56462 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:18.407183 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c50dc-0b01-47e0-b9d3-e4bbd6892a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:18.407801 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c50dc-0b01-47e0-b9d3-e4bbd6892a78 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:18.408076 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c50dc-0b01-47e0-b9d3-e4bbd6892a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:18.408372 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c50dc-0b01-47e0-b9d3-e4bbd6892a78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:18.418381 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c50dc-0b01-47e0-b9d3-e4bbd6892a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-321c50dc-0b01-47e0-b9d3-e4bbd6892a78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 19:08:18.423383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:18.424552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:18.425788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 343/680] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Oct 20 19:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:18.430486 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369b303-2f09-4e9a-81cf-433b06bedcf4 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:18.433515 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:18.525415 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369b303-2f09-4e9a-81cf-433b06bedcf4 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:18.558241 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada63e4-2cc7-4953-a740-0c28cfd8887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:18.558835 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada63e4-2cc7-4953-a740-0c28cfd8887b None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:18.559112 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada63e4-2cc7-4953-a740-0c28cfd8887b None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:18.559382 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada63e4-2cc7-4953-a740-0c28cfd8887b None admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:18.560035 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada63e4-2cc7-4953-a740-0c28cfd8887b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:18.560370 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada63e4-2cc7-4953-a740-0c28cfd8887b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:18.561723 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada63e4-2cc7-4953-a740-0c28cfd8887b None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:18.570103 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 338/681] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Oct 20 19:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:18.575962 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c50dc-0b01-47e0-b9d3-e4bbd6892a78 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:18.667800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:18.674003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c50dc-0b01-47e0-b9d3-e4bbd6892a78 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:18.708215 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b0b6b-3a15-4710-933b-513cc1a9ca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:18.708853 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b0b6b-3a15-4710-933b-513cc1a9ca8d None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:18.709127 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b0b6b-3a15-4710-933b-513cc1a9ca8d None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:18.709393 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b0b6b-3a15-4710-933b-513cc1a9ca8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:18.718946 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b0b6b-3a15-4710-933b-513cc1a9ca8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:18.720375 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b0b6b-3a15-4710-933b-513cc1a9ca8d None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-bc2b0b6b-3a15-4710-933b-513cc1a9ca8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:08:18.734720 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:18.735667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:08:18.736781 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:08:18.736781 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:18.736781 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:18.736781 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 344/682] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:18.741641 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada63e4-2cc7-4953-a740-0c28cfd8887b None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:18.805280 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:18.839079 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada63e4-2cc7-4953-a740-0c28cfd8887b None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:18.871230 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcad0f-283d-4ef3-9717-b80d10b9a944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:18.871812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcad0f-283d-4ef3-9717-b80d10b9a944 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:18.872086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcad0f-283d-4ef3-9717-b80d10b9a944 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:18.872380 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcad0f-283d-4ef3-9717-b80d10b9a944 None admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:18.873009 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcad0f-283d-4ef3-9717-b80d10b9a944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:18.873307 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcad0f-283d-4ef3-9717-b80d10b9a944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:18.874784 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcad0f-283d-4ef3-9717-b80d10b9a944 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:18.885945 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 339/683] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:18.892114 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b0b6b-3a15-4710-933b-513cc1a9ca8d None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:18.986938 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b0b6b-3a15-4710-933b-513cc1a9ca8d None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:19.019079 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870ba7-7d00-42a9-b15c-eb464fbe2281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:19.019934 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870ba7-7d00-42a9-b15c-eb464fbe2281 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:19.020215 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870ba7-7d00-42a9-b15c-eb464fbe2281 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:19.020513 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870ba7-7d00-42a9-b15c-eb464fbe2281 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:19.027519 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7870ba7-7d00-42a9-b15c-eb464fbe2281 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:19.028960 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7870ba7-7d00-42a9-b15c-eb464fbe2281 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-f7870ba7-7d00-42a9-b15c-eb464fbe2281 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 19:08:19.039931 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:19.044380 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:19.045579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:19.045579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:19.045579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 19:08:19.045579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 19:08:19.045579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 19:08:19.045579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 19:08:19.045579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 19:08:19.045579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 19:08:19.045579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 19:08:19.045579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:19.045579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 345/684] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:19.048020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcad0f-283d-4ef3-9717-b80d10b9a944 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:19.143492 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcad0f-283d-4ef3-9717-b80d10b9a944 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:19.168303 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:19.177093 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfd728-de0a-49e5-90a1-27f4311dfa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:19.177677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd728-de0a-49e5-90a1-27f4311dfa13 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:19.177950 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd728-de0a-49e5-90a1-27f4311dfa13 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:19.178217 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfd728-de0a-49e5-90a1-27f4311dfa13 None admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:19.178920 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfd728-de0a-49e5-90a1-27f4311dfa13 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:19.179221 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfd728-de0a-49e5-90a1-27f4311dfa13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:19.180660 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfd728-de0a-49e5-90a1-27f4311dfa13 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:19.197406 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 340/685] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Oct 20 19:08:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:19.203989 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870ba7-7d00-42a9-b15c-eb464fbe2281 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:19.217324 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:19.303774 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870ba7-7d00-42a9-b15c-eb464fbe2281 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:19.336759 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8ded8-7966-4436-912e-a4c6481120ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:19.337344 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ded8-7966-4436-912e-a4c6481120ee None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:19.337620 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ded8-7966-4436-912e-a4c6481120ee None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:19.337885 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ded8-7966-4436-912e-a4c6481120ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:19.410412 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8ded8-7966-4436-912e-a4c6481120ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:19.411772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8ded8-7966-4436-912e-a4c6481120ee None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:19.421860 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:19.506049 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 346/686] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Oct 20 19:08:19 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 19:08:19.511906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfd728-de0a-49e5-90a1-27f4311dfa13 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:19.607581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfd728-de0a-49e5-90a1-27f4311dfa13 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:19.640083 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248e273-1473-44ef-92e9-daa0813c4320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:19.640714 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248e273-1473-44ef-92e9-daa0813c4320 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:19.640994 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248e273-1473-44ef-92e9-daa0813c4320 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:19.641251 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248e273-1473-44ef-92e9-daa0813c4320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:19.650612 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248e273-1473-44ef-92e9-daa0813c4320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:19.652030 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248e273-1473-44ef-92e9-daa0813c4320 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-a248e273-1473-44ef-92e9-daa0813c4320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 19:08:19.666086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:19.667259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 19:08:19.668542 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 19:08:19.668542 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 19:08:19.668542 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:08:19.668542 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 341/687] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:19.673218 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8ded8-7966-4436-912e-a4c6481120ee None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:19.769052 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8ded8-7966-4436-912e-a4c6481120ee None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:19.777792 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:19.802105 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba886324-33f8-4bfa-8e88-4dc61c5fca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:19.802690 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba886324-33f8-4bfa-8e88-4dc61c5fca0c None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:19.802961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba886324-33f8-4bfa-8e88-4dc61c5fca0c None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:19.803226 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba886324-33f8-4bfa-8e88-4dc61c5fca0c None admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:19.803843 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba886324-33f8-4bfa-8e88-4dc61c5fca0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:19.804137 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba886324-33f8-4bfa-8e88-4dc61c5fca0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:19.805501 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba886324-33f8-4bfa-8e88-4dc61c5fca0c None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:19.816676 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 347/688] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Oct 20 19:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:19.822306 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248e273-1473-44ef-92e9-daa0813c4320 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:19.856052 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:19.919611 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248e273-1473-44ef-92e9-daa0813c4320 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:19.951687 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0706fe-a66b-4a97-b73d-b4c5a5f792b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:19.952306 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0706fe-a66b-4a97-b73d-b4c5a5f792b9 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:19.952585 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0706fe-a66b-4a97-b73d-b4c5a5f792b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:19.952851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0706fe-a66b-4a97-b73d-b4c5a5f792b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:19.959199 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0706fe-a66b-4a97-b73d-b4c5a5f792b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:19.960633 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0706fe-a66b-4a97-b73d-b4c5a5f792b9 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application [None req-8f0706fe-a66b-4a97-b73d-b4c5a5f792b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 19:08:19.971802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:19.972790 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:19.973785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 19:08:19.973785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 19:08:19.973785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 19:08:19.973785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 19:08:19.973785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 19:08:19.973785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 19:08:19.973785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 19:08:19.973785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: ERROR keystone.server.flask.application Oct 20 19:08:19.973785 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 342/689] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Oct 20 19:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:19.978676 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba886324-33f8-4bfa-8e88-4dc61c5fca0c None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:20.073789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba886324-33f8-4bfa-8e88-4dc61c5fca0c None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:20.105345 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c1685-ceb2-4a7d-a31f-8c5e246e850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:20.105919 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1685-ceb2-4a7d-a31f-8c5e246e850a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:20.106190 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1685-ceb2-4a7d-a31f-8c5e246e850a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:20.106452 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1685-ceb2-4a7d-a31f-8c5e246e850a None admin] PATH_INFO: `/v3/projects` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:20.107116 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c1685-ceb2-4a7d-a31f-8c5e246e850a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:20.107413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c1685-ceb2-4a7d-a31f-8c5e246e850a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:20.108844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c1685-ceb2-4a7d-a31f-8c5e246e850a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:20.120666 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 348/690] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Oct 20 19:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:20.126930 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0706fe-a66b-4a97-b73d-b4c5a5f792b9 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:20.217875 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:20.224863 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0706fe-a66b-4a97-b73d-b4c5a5f792b9 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:20.257517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802556e-7659-4a3d-8b93-ad07a028a075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:20.258097 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802556e-7659-4a3d-8b93-ad07a028a075 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:20.258373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802556e-7659-4a3d-8b93-ad07a028a075 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:20.258643 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802556e-7659-4a3d-8b93-ad07a028a075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:20.259354 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802556e-7659-4a3d-8b93-ad07a028a075 None admin] RBAC: Adding query filter params (role.id=fde247f30afe4b81958b67c776cabec0, scope.project.id=75fce313b5e242adb9eb825bc017e358, user.id=43fc68da6f184762a5e7312ce37f4988) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:20.259658 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802556e-7659-4a3d-8b93-ad07a028a075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:20.261101 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802556e-7659-4a3d-8b93-ad07a028a075 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:20.267287 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 343/691] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Oct 20 19:08:20 2022] GET /identity/v3/role_assignments?user.id=43fc68da6f184762a5e7312ce37f4988&scope.project.id=75fce313b5e242adb9eb825bc017e358&role.id=fde247f30afe4b81958b67c776cabec0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:22.698960 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78acba-9478-43e7-9011-91a14807e0a3 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:22.699442 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78acba-9478-43e7-9011-91a14807e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:22.699535 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78acba-9478-43e7-9011-91a14807e0a3 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:22.700839 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 349/692] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:08:22.706659 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38bcd0-51cb-4eb7-bcf9-80e872f32a28 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:22.707066 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38bcd0-51cb-4eb7-bcf9-80e872f32a28 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:22.707198 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38bcd0-51cb-4eb7-bcf9-80e872f32a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:22.725601 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-2e38bcd0-51cb-4eb7-bcf9-80e872f32a28 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:08:22.726771 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-2e38bcd0-51cb-4eb7-bcf9-80e872f32a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:08:22.792699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 344/693] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:08:22 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:08:23.117558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78acba-9478-43e7-9011-91a14807e0a3 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:23.146153 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:23.217534 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78acba-9478-43e7-9011-91a14807e0a3 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:23.255067 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb90e-ef9f-4c8b-84f0-bf7403102545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:23.255674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb90e-ef9f-4c8b-84f0-bf7403102545 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:23.255946 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb90e-ef9f-4c8b-84f0-bf7403102545 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:23.256212 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb90e-ef9f-4c8b-84f0-bf7403102545 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:23.256806 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acb90e-ef9f-4c8b-84f0-bf7403102545 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:23.258147 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acb90e-ef9f-4c8b-84f0-bf7403102545 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-c9acb90e-ef9f-4c8b-84f0-bf7403102545 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:23.267415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:23.268668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:23.269712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 350/694] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 19:08:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:23.274449 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38bcd0-51cb-4eb7-bcf9-80e872f32a28 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:23.363812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:23.376228 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38bcd0-51cb-4eb7-bcf9-80e872f32a28 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:23.410031 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2766d00-755b-4490-b4df-bb50e5b8cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:23.410617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2766d00-755b-4490-b4df-bb50e5b8cd59 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:23.410887 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2766d00-755b-4490-b4df-bb50e5b8cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:23.411154 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2766d00-755b-4490-b4df-bb50e5b8cd59 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:23.411763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2766d00-755b-4490-b4df-bb50e5b8cd59 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:23.412060 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2766d00-755b-4490-b4df-bb50e5b8cd59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:23.413458 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2766d00-755b-4490-b4df-bb50e5b8cd59 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:23.418287 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 345/695] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Oct 20 19:08:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:23.425036 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb90e-ef9f-4c8b-84f0-bf7403102545 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:23.512332 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:23.521034 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb90e-ef9f-4c8b-84f0-bf7403102545 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:23.552851 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525081a-adf9-40eb-bec7-94f68ca1e9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:23.553432 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525081a-adf9-40eb-bec7-94f68ca1e9f7 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:23.553722 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525081a-adf9-40eb-bec7-94f68ca1e9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:23.553968 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525081a-adf9-40eb-bec7-94f68ca1e9f7 None admin] PATH_INFO: `/v3/services` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:23.554578 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525081a-adf9-40eb-bec7-94f68ca1e9f7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:23.554874 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525081a-adf9-40eb-bec7-94f68ca1e9f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:23.556207 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525081a-adf9-40eb-bec7-94f68ca1e9f7 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:23.560385 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 351/696] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Oct 20 19:08:23 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:25.939269 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f194-5db1-485c-8c63-1cd00d438c32 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:25.939794 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f194-5db1-485c-8c63-1cd00d438c32 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:25.939794 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429f194-5db1-485c-8c63-1cd00d438c32 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:25.941157 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 346/697] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:08:25.946479 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141738b-ed44-4bda-9bb6-7d32a44411b7 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:25.946891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141738b-ed44-4bda-9bb6-7d32a44411b7 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:25.946983 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141738b-ed44-4bda-9bb6-7d32a44411b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:25.964673 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-a141738b-ed44-4bda-9bb6-7d32a44411b7 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:08:25.965838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-a141738b-ed44-4bda-9bb6-7d32a44411b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:08:26.029622 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 352/698] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:08:25 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 19:08:26.352487 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429f194-5db1-485c-8c63-1cd00d438c32 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:26.464191 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429f194-5db1-485c-8c63-1cd00d438c32 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:26.496665 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fab0ca-89e6-4060-83e0-b61e59bf7f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:26.497258 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fab0ca-89e6-4060-83e0-b61e59bf7f89 None admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:26.497535 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fab0ca-89e6-4060-83e0-b61e59bf7f89 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:26.497804 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fab0ca-89e6-4060-83e0-b61e59bf7f89 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:26.498449 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fab0ca-89e6-4060-83e0-b61e59bf7f89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:26.500496 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fab0ca-89e6-4060-83e0-b61e59bf7f89 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:26.514134 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 347/699] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Oct 20 19:08:26 2022] POST /identity/v3/services => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:08:28.916225 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82af65-5518-46df-b660-ae0863d385aa None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:28.916874 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82af65-5518-46df-b660-ae0863d385aa None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:28.916874 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82af65-5518-46df-b660-ae0863d385aa None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:28.918085 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 353/700] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:08:28.923892 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d1ae6-6c43-42be-81f0-3e3767aecaf0 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:28.924321 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d1ae6-6c43-42be-81f0-3e3767aecaf0 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:28.924462 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d1ae6-6c43-42be-81f0-3e3767aecaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:28.942398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-1b3d1ae6-6c43-42be-81f0-3e3767aecaf0 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:08:28.943494 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-1b3d1ae6-6c43-42be-81f0-3e3767aecaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:08:28.952362 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:29.013875 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 348/701] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:08:28 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:08:29.333215 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82af65-5518-46df-b660-ae0863d385aa None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:29.424652 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:29.442056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82af65-5518-46df-b660-ae0863d385aa None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:29.473913 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8e962-4753-4a2c-9dbb-85288f51283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:29.474517 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e962-4753-4a2c-9dbb-85288f51283a None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:29.474788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e962-4753-4a2c-9dbb-85288f51283a None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:29.475050 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e962-4753-4a2c-9dbb-85288f51283a None admin] PATH_INFO: `/v3/services/placement` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:29.475614 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8e962-4753-4a2c-9dbb-85288f51283a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:29.476973 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8e962-4753-4a2c-9dbb-85288f51283a None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-cdf8e962-4753-4a2c-9dbb-85288f51283a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:29.485896 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:29.487061 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:29.488101 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 354/702] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 19:08:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:29.492963 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d1ae6-6c43-42be-81f0-3e3767aecaf0 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:29.593043 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d1ae6-6c43-42be-81f0-3e3767aecaf0 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:29.626412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0f5a9-928c-4605-abdc-a3b73bbb1735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:29.626997 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0f5a9-928c-4605-abdc-a3b73bbb1735 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:29.627273 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0f5a9-928c-4605-abdc-a3b73bbb1735 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:29.627535 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0f5a9-928c-4605-abdc-a3b73bbb1735 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:29.628144 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0f5a9-928c-4605-abdc-a3b73bbb1735 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:29.628471 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0f5a9-928c-4605-abdc-a3b73bbb1735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:29.629827 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0f5a9-928c-4605-abdc-a3b73bbb1735 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:29.634640 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 349/703] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Oct 20 19:08:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:29.640595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8e962-4753-4a2c-9dbb-85288f51283a None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:29.737565 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8e962-4753-4a2c-9dbb-85288f51283a None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:29.769203 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fd5ee-212e-490c-a422-9e0f362e3f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:29.769794 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd5ee-212e-490c-a422-9e0f362e3f17 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:29.770074 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd5ee-212e-490c-a422-9e0f362e3f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:29.770344 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fd5ee-212e-490c-a422-9e0f362e3f17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:29.771027 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fd5ee-212e-490c-a422-9e0f362e3f17 None admin] RBAC: Adding query filter params (interface=public, service_id=b6e64c6c15bd4abfa48e5112ddd32935, region_id=RegionOne) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:29.771334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fd5ee-212e-490c-a422-9e0f362e3f17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:29.772707 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fd5ee-212e-490c-a422-9e0f362e3f17 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:29.777460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 355/704] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Oct 20 19:08:29 2022] GET /identity/v3/endpoints?service_id=b6e64c6c15bd4abfa48e5112ddd32935&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:29.783644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0f5a9-928c-4605-abdc-a3b73bbb1735 None admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:29.787334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:29.884571 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0f5a9-928c-4605-abdc-a3b73bbb1735 None admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:29.917229 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455019d4-60d0-4e02-a208-39088af52b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:29.917815 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455019d4-60d0-4e02-a208-39088af52b68 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:29.918091 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455019d4-60d0-4e02-a208-39088af52b68 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:29.918359 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455019d4-60d0-4e02-a208-39088af52b68 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:29.918948 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455019d4-60d0-4e02-a208-39088af52b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:29.920324 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455019d4-60d0-4e02-a208-39088af52b68 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:29.927393 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 350/705] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Oct 20 19:08:29 2022] GET /identity/v3/services => generated 1962 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:08:32.270947 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41466902-791c-4a9a-95ee-6e84a5a1bd65 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:32.271491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41466902-791c-4a9a-95ee-6e84a5a1bd65 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:32.271491 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41466902-791c-4a9a-95ee-6e84a5a1bd65 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:32.272878 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 356/706] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:08:32.277858 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df403d83-0265-4ee0-b82f-97bc5d8347f7 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:32.278302 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df403d83-0265-4ee0-b82f-97bc5d8347f7 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:32.278405 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df403d83-0265-4ee0-b82f-97bc5d8347f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:32.296925 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-df403d83-0265-4ee0-b82f-97bc5d8347f7 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:08:32.298091 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-df403d83-0265-4ee0-b82f-97bc5d8347f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:08:32.357121 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:32.364484 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 351/707] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:08:32 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 19:08:32.682390 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41466902-791c-4a9a-95ee-6e84a5a1bd65 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:32.699205 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:32.782072 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41466902-791c-4a9a-95ee-6e84a5a1bd65 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:32.814798 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d87461-8ebc-4b0e-aaee-568af85f0673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:32.815414 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d87461-8ebc-4b0e-aaee-568af85f0673 None admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:32.815688 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d87461-8ebc-4b0e-aaee-568af85f0673 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:32.815956 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d87461-8ebc-4b0e-aaee-568af85f0673 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:32.816559 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d87461-8ebc-4b0e-aaee-568af85f0673 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:32.817901 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d87461-8ebc-4b0e-aaee-568af85f0673 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application [None req-d2d87461-8ebc-4b0e-aaee-568af85f0673 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 19:08:32.826374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 19:08:32.828250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application with Lock( Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self._enter() Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application return self.creator() Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application created_value = creator( Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: ERROR keystone.server.flask.application Oct 20 19:08:32.829392 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 357/708] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Oct 20 19:08:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 19:08:32.834140 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df403d83-0265-4ee0-b82f-97bc5d8347f7 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:33.051244 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df403d83-0265-4ee0-b82f-97bc5d8347f7 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:33.084449 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d486996-ca88-4d73-98b0-866425a71d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:33.085035 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d486996-ca88-4d73-98b0-866425a71d65 None admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:33.085309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d486996-ca88-4d73-98b0-866425a71d65 None admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:33.085576 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d486996-ca88-4d73-98b0-866425a71d65 None admin] PATH_INFO: `/v3/services` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:33.086188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d486996-ca88-4d73-98b0-866425a71d65 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:08:33.086481 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d486996-ca88-4d73-98b0-866425a71d65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:33.087827 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d486996-ca88-4d73-98b0-866425a71d65 None admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:33.093136 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 352/709] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Oct 20 19:08:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:08:33.098537 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d87461-8ebc-4b0e-aaee-568af85f0673 None admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:08:33.174822 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:33.196028 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d87461-8ebc-4b0e-aaee-568af85f0673 None admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:08:33.227650 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d67e4-e3a6-4ba7-8949-bcac228cdfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:08:33.228227 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d67e4-e3a6-4ba7-8949-bcac228cdfd4 None admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:08:33.228538 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d67e4-e3a6-4ba7-8949-bcac228cdfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:08:33.228807 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d67e4-e3a6-4ba7-8949-bcac228cdfd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:08:33.229460 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d67e4-e3a6-4ba7-8949-bcac228cdfd4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:08:33.230791 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d67e4-e3a6-4ba7-8949-bcac228cdfd4 None admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:08:33.250913 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 358/710] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:08:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:08:43.089952 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=69 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:08:43.245902 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:09:32.783713 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c47024-22cc-41ae-aa1c-c233f9164246 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:32.784316 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c47024-22cc-41ae-aa1c-c233f9164246 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:32.784316 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c47024-22cc-41ae-aa1c-c233f9164246 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:32.785748 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 353/711] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:09:32.791144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f78abf-aeb1-4f5b-9085-0e9733cbbadf None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:32.791582 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f78abf-aeb1-4f5b-9085-0e9733cbbadf None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:32.791674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f78abf-aeb1-4f5b-9085-0e9733cbbadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:32.816079 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-95f78abf-aeb1-4f5b-9085-0e9733cbbadf None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:09:32.818163 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-95f78abf-aeb1-4f5b-9085-0e9733cbbadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:09:32.899355 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 359/712] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:09:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:09:33.254180 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5fcde-41d8-4430-9159-2af777b484fe None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:33.254628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5fcde-41d8-4430-9159-2af777b484fe None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:33.254906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5fcde-41d8-4430-9159-2af777b484fe None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:33.256494 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 354/713] 10.222.0.16 () {54 vars in 964 bytes} [Thu Oct 20 19:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:09:33.273351 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4f3e4-2ae5-4766-878b-76cce82c8105 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:33.273650 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4f3e4-2ae5-4766-878b-76cce82c8105 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:33.273925 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4f3e4-2ae5-4766-878b-76cce82c8105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:33.478229 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-55b4f3e4-2ae5-4766-878b-76cce82c8105 None None] MFA Rules not processed for user `09fce752a3264bb19af1260da2b83315`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:09:33.479441 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-55b4f3e4-2ae5-4766-878b-76cce82c8105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:09:33.538682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 360/714] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Oct 20 19:09:33 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:09:33.547763 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5fcde-41d8-4430-9159-2af777b484fe None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:09:33.558184 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5fcde-41d8-4430-9159-2af777b484fe None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:09:33.562227 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5921db-e1f7-476a-b0d1-f04532aa12c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:09:33.562870 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5921db-e1f7-476a-b0d1-f04532aa12c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:33.563206 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5921db-e1f7-476a-b0d1-f04532aa12c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:33.563533 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5921db-e1f7-476a-b0d1-f04532aa12c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:33.572325 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5921db-e1f7-476a-b0d1-f04532aa12c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:09:33.573783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5921db-e1f7-476a-b0d1-f04532aa12c3 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:09:33.583846 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 355/715] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:09:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:09:36.309967 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c154ba6-002b-4d2f-9152-3bf7cc12be1c None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:36.310456 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c154ba6-002b-4d2f-9152-3bf7cc12be1c None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:36.310550 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c154ba6-002b-4d2f-9152-3bf7cc12be1c None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:36.312000 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 361/716] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:09:36.317228 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a9d3-ffd7-4b57-a16a-22500aba9d1d None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:36.317632 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a9d3-ffd7-4b57-a16a-22500aba9d1d None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:36.317808 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a9d3-ffd7-4b57-a16a-22500aba9d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:36.337796 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-a0c6a9d3-ffd7-4b57-a16a-22500aba9d1d None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:09:36.338973 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-a0c6a9d3-ffd7-4b57-a16a-22500aba9d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:09:36.347844 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 356/717] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:09:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:09:36.698013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9046c-57bb-4079-8fd5-91d4239274f8 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:36.698301 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9046c-57bb-4079-8fd5-91d4239274f8 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:36.698576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9046c-57bb-4079-8fd5-91d4239274f8 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:36.700034 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 362/718] 10.222.0.16 () {54 vars in 964 bytes} [Thu Oct 20 19:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:09:36.706778 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32182c3-515c-4e3e-807c-e92bdfc2167b None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:36.707131 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32182c3-515c-4e3e-807c-e92bdfc2167b None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:36.707467 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32182c3-515c-4e3e-807c-e92bdfc2167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:36.727113 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-e32182c3-515c-4e3e-807c-e92bdfc2167b None None] MFA Rules not processed for user `09fce752a3264bb19af1260da2b83315`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:09:36.728405 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-e32182c3-515c-4e3e-807c-e92bdfc2167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:09:36.735684 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 357/719] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Oct 20 19:09:36 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:09:36.744356 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9046c-57bb-4079-8fd5-91d4239274f8 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:09:36.754728 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9046c-57bb-4079-8fd5-91d4239274f8 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:09:36.758245 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503f467-a750-412e-ac0f-ddb5fe6d9b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:09:36.758844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f467-a750-412e-ac0f-ddb5fe6d9b70 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:36.759115 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f467-a750-412e-ac0f-ddb5fe6d9b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:36.759383 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f467-a750-412e-ac0f-ddb5fe6d9b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:36.773004 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503f467-a750-412e-ac0f-ddb5fe6d9b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:09:36.774433 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503f467-a750-412e-ac0f-ddb5fe6d9b70 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:09:36.784636 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 363/720] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:09:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:09:39.801135 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e882-5d9c-42df-af90-552f22b7f3b0 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:39.801674 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e882-5d9c-42df-af90-552f22b7f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:39.801674 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9e882-5d9c-42df-af90-552f22b7f3b0 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:39.803049 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 358/721] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:09:39.808916 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102777b-f705-4525-af73-ae5ec6faf9e9 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:39.809472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102777b-f705-4525-af73-ae5ec6faf9e9 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:39.809472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102777b-f705-4525-af73-ae5ec6faf9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:39.850745 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-0102777b-f705-4525-af73-ae5ec6faf9e9 None None] MFA Rules not processed for user `6b79b1b5bdfa48c3be283dd8d7efa8f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:09:39.851964 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-0102777b-f705-4525-af73-ae5ec6faf9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:09:39.897224 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:09:39.925521 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 364/722] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:09:39 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:09:40.262013 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9e882-5d9c-42df-af90-552f22b7f3b0 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:09:40.272976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9e882-5d9c-42df-af90-552f22b7f3b0 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:09:40.276375 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720b75f-c19f-46fd-a5a0-2100be1d5264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:09:40.276948 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b75f-c19f-46fd-a5a0-2100be1d5264 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:40.277214 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b75f-c19f-46fd-a5a0-2100be1d5264 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:40.277472 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720b75f-c19f-46fd-a5a0-2100be1d5264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:40.285992 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720b75f-c19f-46fd-a5a0-2100be1d5264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:09:40.287380 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720b75f-c19f-46fd-a5a0-2100be1d5264 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:09:40.296684 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 359/723] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:09:40 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:09:43.221391 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836963c-9302-4b2a-b0ac-df730a413d88 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:43.221946 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836963c-9302-4b2a-b0ac-df730a413d88 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:43.221946 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836963c-9302-4b2a-b0ac-df730a413d88 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:43.223245 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 365/724] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:09:43.228522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0717adb-4b9f-46e7-bbcf-1edb196cf5fa None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:43.228906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0717adb-4b9f-46e7-bbcf-1edb196cf5fa None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:43.229052 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0717adb-4b9f-46e7-bbcf-1edb196cf5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:43.247933 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-a0717adb-4b9f-46e7-bbcf-1edb196cf5fa None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:09:43.249066 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-a0717adb-4b9f-46e7-bbcf-1edb196cf5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:09:43.313718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 360/725] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:09:43 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:09:43.654961 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836963c-9302-4b2a-b0ac-df730a413d88 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:09:43.665738 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836963c-9302-4b2a-b0ac-df730a413d88 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:09:43.669233 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ca208-d184-409e-9d39-f7428b48c0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:09:43.669804 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca208-d184-409e-9d39-f7428b48c0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:43.670080 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca208-d184-409e-9d39-f7428b48c0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:43.670352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ca208-d184-409e-9d39-f7428b48c0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:43.678958 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ca208-d184-409e-9d39-f7428b48c0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:09:43.680388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ca208-d184-409e-9d39-f7428b48c0b2 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:09:43.689560 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 366/726] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:09:43 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:09:46.728012 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398a081-3fb9-42b9-913b-c27c6a36b3e4 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:46.728549 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398a081-3fb9-42b9-913b-c27c6a36b3e4 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:46.728642 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398a081-3fb9-42b9-913b-c27c6a36b3e4 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:46.729916 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 361/727] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:09:46.735520 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658565f-7b74-4d8c-8a39-c703d48f807a None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:46.735930 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658565f-7b74-4d8c-8a39-c703d48f807a None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:46.736041 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658565f-7b74-4d8c-8a39-c703d48f807a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:46.755613 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-a658565f-7b74-4d8c-8a39-c703d48f807a None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:09:46.756802 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-a658565f-7b74-4d8c-8a39-c703d48f807a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:09:46.764295 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 367/728] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:09:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:09:47.101617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398a081-3fb9-42b9-913b-c27c6a36b3e4 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:09:47.113561 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398a081-3fb9-42b9-913b-c27c6a36b3e4 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:09:47.117011 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e134bef-83d3-4d52-866d-fd0ce4e6a19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:09:47.117598 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134bef-83d3-4d52-866d-fd0ce4e6a19e service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:47.117872 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134bef-83d3-4d52-866d-fd0ce4e6a19e service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:47.118136 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e134bef-83d3-4d52-866d-fd0ce4e6a19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:47.128393 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e134bef-83d3-4d52-866d-fd0ce4e6a19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:09:47.129818 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e134bef-83d3-4d52-866d-fd0ce4e6a19e service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:09:47.140319 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 362/729] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:09:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:09:49.663695 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5982-e5a4-4eea-a371-748276246b23 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:49.664229 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5982-e5a4-4eea-a371-748276246b23 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:49.664229 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5982-e5a4-4eea-a371-748276246b23 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:49.665556 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 368/730] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:09:49.670687 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb84d8-7b5b-4dfa-b745-5161122e5f24 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:49.671137 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb84d8-7b5b-4dfa-b745-5161122e5f24 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:49.671231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb84d8-7b5b-4dfa-b745-5161122e5f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:49.692146 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-0abb84d8-7b5b-4dfa-b745-5161122e5f24 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:09:49.692146 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-0abb84d8-7b5b-4dfa-b745-5161122e5f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:09:49.698834 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 363/731] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:09:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:09:50.039037 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5982-e5a4-4eea-a371-748276246b23 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:09:50.049916 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5982-e5a4-4eea-a371-748276246b23 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:09:50.053396 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581734-b74b-46ba-9b51-dd8184036dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:09:50.054012 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581734-b74b-46ba-9b51-dd8184036dad service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:50.054267 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581734-b74b-46ba-9b51-dd8184036dad service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:50.054532 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581734-b74b-46ba-9b51-dd8184036dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:50.063654 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581734-b74b-46ba-9b51-dd8184036dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:09:50.065090 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581734-b74b-46ba-9b51-dd8184036dad service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:09:50.074175 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 369/732] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:09:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:09:52.519095 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c5fa-cf03-42b7-86d9-718ce7feeedc None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:52.519623 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c5fa-cf03-42b7-86d9-718ce7feeedc None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:52.519714 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c5fa-cf03-42b7-86d9-718ce7feeedc None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:52.521059 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 364/733] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:09:52.526423 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec027d4d-c3b6-43d2-a6a6-754fd6ae2134 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:52.526850 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec027d4d-c3b6-43d2-a6a6-754fd6ae2134 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:52.526987 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec027d4d-c3b6-43d2-a6a6-754fd6ae2134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:52.546479 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-ec027d4d-c3b6-43d2-a6a6-754fd6ae2134 None None] MFA Rules not processed for user `6b79b1b5bdfa48c3be283dd8d7efa8f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:09:52.547646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-ec027d4d-c3b6-43d2-a6a6-754fd6ae2134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:09:52.555177 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 370/734] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:09:52 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:09:52.886579 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13c5fa-cf03-42b7-86d9-718ce7feeedc None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:09:52.897945 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13c5fa-cf03-42b7-86d9-718ce7feeedc None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:09:52.901515 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139419f-367b-4188-ac70-822febe01f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:09:52.902169 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139419f-367b-4188-ac70-822febe01f59 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:52.902510 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139419f-367b-4188-ac70-822febe01f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:52.902862 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139419f-367b-4188-ac70-822febe01f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:52.911814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139419f-367b-4188-ac70-822febe01f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:09:52.913511 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139419f-367b-4188-ac70-822febe01f59 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:09:52.922883 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 365/735] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:09:52 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:09:55.579870 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73d3dc-8fad-414a-bbf2-ff8ec3be8690 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:55.580424 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73d3dc-8fad-414a-bbf2-ff8ec3be8690 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:55.580793 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73d3dc-8fad-414a-bbf2-ff8ec3be8690 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:55.582694 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 371/736] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:09:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:09:55.588164 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dddd07-aa56-4d2b-b571-b63c8d198926 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:55.588640 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dddd07-aa56-4d2b-b571-b63c8d198926 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:55.588801 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dddd07-aa56-4d2b-b571-b63c8d198926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:55.608781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-77dddd07-aa56-4d2b-b571-b63c8d198926 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:09:55.610075 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-77dddd07-aa56-4d2b-b571-b63c8d198926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:09:55.617898 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 366/737] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:09:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:09:55.955549 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73d3dc-8fad-414a-bbf2-ff8ec3be8690 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:09:55.967199 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73d3dc-8fad-414a-bbf2-ff8ec3be8690 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:09:55.970649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf1282-bf45-45fa-ba68-63e56fa4331c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:09:55.971230 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1282-bf45-45fa-ba68-63e56fa4331c service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:55.971505 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1282-bf45-45fa-ba68-63e56fa4331c service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:55.971772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf1282-bf45-45fa-ba68-63e56fa4331c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:55.980314 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf1282-bf45-45fa-ba68-63e56fa4331c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:09:55.982592 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf1282-bf45-45fa-ba68-63e56fa4331c service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:09:55.991960 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 372/738] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:09:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:09:58.448575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40c22-0c68-4a2a-af3e-814dac89ae3c None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:58.449094 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40c22-0c68-4a2a-af3e-814dac89ae3c None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:58.449094 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40c22-0c68-4a2a-af3e-814dac89ae3c None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:58.451127 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 367/739] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:09:58.456441 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1f0cc-a27a-48e3-872e-6a8a47278ced None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:58.456861 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1f0cc-a27a-48e3-872e-6a8a47278ced None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:58.456981 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1f0cc-a27a-48e3-872e-6a8a47278ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:58.479653 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-3ad1f0cc-a27a-48e3-872e-6a8a47278ced None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:09:58.480855 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-3ad1f0cc-a27a-48e3-872e-6a8a47278ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:09:58.488970 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 373/740] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:09:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:09:58.830559 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40c22-0c68-4a2a-af3e-814dac89ae3c None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:09:58.841803 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40c22-0c68-4a2a-af3e-814dac89ae3c None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:09:58.845255 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e33d5c-7c88-4c56-b467-e3248ff9f953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:09:58.845832 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e33d5c-7c88-4c56-b467-e3248ff9f953 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:09:58.846110 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e33d5c-7c88-4c56-b467-e3248ff9f953 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:09:58.846375 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e33d5c-7c88-4c56-b467-e3248ff9f953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:09:58.854928 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e33d5c-7c88-4c56-b467-e3248ff9f953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:09:58.856974 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e33d5c-7c88-4c56-b467-e3248ff9f953 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:09:58.865981 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 368/741] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:09:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:01.568674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97278a4f-009b-4b4f-a6a4-49b26ea35218 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:01.569256 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97278a4f-009b-4b4f-a6a4-49b26ea35218 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:01.569256 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97278a4f-009b-4b4f-a6a4-49b26ea35218 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:01.570532 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 374/742] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:01.576495 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8543b-8bc6-4e33-8702-5c99df18547f None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:01.576923 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8543b-8bc6-4e33-8702-5c99df18547f None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:01.577116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8543b-8bc6-4e33-8702-5c99df18547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:01.597380 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-2fa8543b-8bc6-4e33-8702-5c99df18547f None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:01.598542 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-2fa8543b-8bc6-4e33-8702-5c99df18547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:01.606392 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 369/743] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:01 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:01.941701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97278a4f-009b-4b4f-a6a4-49b26ea35218 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:01.952444 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97278a4f-009b-4b4f-a6a4-49b26ea35218 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:01.955859 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e81188-34df-44dd-a8dd-f7ee36548b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:01.956481 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e81188-34df-44dd-a8dd-f7ee36548b26 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:01.956754 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e81188-34df-44dd-a8dd-f7ee36548b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:01.957018 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e81188-34df-44dd-a8dd-f7ee36548b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:01.965998 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e81188-34df-44dd-a8dd-f7ee36548b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:01.967396 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e81188-34df-44dd-a8dd-f7ee36548b26 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:01.976427 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 375/744] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:01 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:06.329686 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb432c-05dc-47ae-b217-5037e8a21990 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:06.330211 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb432c-05dc-47ae-b217-5037e8a21990 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:06.330211 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb432c-05dc-47ae-b217-5037e8a21990 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:06.331567 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 370/745] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:06.336669 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a855e-2de7-4348-baed-de4b5385306f None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:06.337082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a855e-2de7-4348-baed-de4b5385306f None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:06.337253 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a855e-2de7-4348-baed-de4b5385306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:06.356791 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-7a8a855e-2de7-4348-baed-de4b5385306f None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:06.358078 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-7a8a855e-2de7-4348-baed-de4b5385306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:06.366013 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 376/746] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:06.699837 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb432c-05dc-47ae-b217-5037e8a21990 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:06.705199 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=77 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:10:06.711956 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb432c-05dc-47ae-b217-5037e8a21990 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:06.716057 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a445f7-5302-4629-b8a2-d295fa941ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:06.716700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a445f7-5302-4629-b8a2-d295fa941ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:06.716977 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a445f7-5302-4629-b8a2-d295fa941ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:06.717247 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a445f7-5302-4629-b8a2-d295fa941ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:06.726213 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a445f7-5302-4629-b8a2-d295fa941ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:06.727662 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a445f7-5302-4629-b8a2-d295fa941ed0 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:06.738890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 371/747] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:10.165988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eb1b1-de65-4704-9c11-712022c6c4e0 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:10.166517 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eb1b1-de65-4704-9c11-712022c6c4e0 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:10.166517 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155eb1b1-de65-4704-9c11-712022c6c4e0 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:10.167838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 377/748] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:10.173247 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97d315-8190-4dc0-9fe4-f6ec741d6307 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:10.173678 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97d315-8190-4dc0-9fe4-f6ec741d6307 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:10.173781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97d315-8190-4dc0-9fe4-f6ec741d6307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:10.192995 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-fc97d315-8190-4dc0-9fe4-f6ec741d6307 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:10.194160 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-fc97d315-8190-4dc0-9fe4-f6ec741d6307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:10.202543 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 372/749] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:10 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:10.543450 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eb1b1-de65-4704-9c11-712022c6c4e0 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:10.548762 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=48 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:10:10.554996 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155eb1b1-de65-4704-9c11-712022c6c4e0 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:10.558438 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29846995-0284-48ae-bb6a-0ca55a836357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:10.559339 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29846995-0284-48ae-bb6a-0ca55a836357 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:10.559607 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29846995-0284-48ae-bb6a-0ca55a836357 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:10.559871 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29846995-0284-48ae-bb6a-0ca55a836357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:10.568601 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29846995-0284-48ae-bb6a-0ca55a836357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:10.569986 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29846995-0284-48ae-bb6a-0ca55a836357 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:10.579820 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 378/750] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:10 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:15.188830 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8599d-9b45-4bb0-afe9-83806121329b None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:15.189599 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8599d-9b45-4bb0-afe9-83806121329b None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:15.190084 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8599d-9b45-4bb0-afe9-83806121329b None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:15.191626 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 373/751] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:15.197044 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37be58-8085-4d74-89e9-e8ce66cf0599 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:15.197483 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37be58-8085-4d74-89e9-e8ce66cf0599 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:15.197591 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37be58-8085-4d74-89e9-e8ce66cf0599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:15.219029 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-4e37be58-8085-4d74-89e9-e8ce66cf0599 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:15.220227 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-4e37be58-8085-4d74-89e9-e8ce66cf0599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:15.228021 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 379/752] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:15.572206 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8599d-9b45-4bb0-afe9-83806121329b None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:15.583528 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8599d-9b45-4bb0-afe9-83806121329b None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:15.587111 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036fa98-b5fa-4d20-ae93-b70fdeda15af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:15.587690 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fa98-b5fa-4d20-ae93-b70fdeda15af service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:15.587966 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fa98-b5fa-4d20-ae93-b70fdeda15af service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:15.588231 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036fa98-b5fa-4d20-ae93-b70fdeda15af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:15.597254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036fa98-b5fa-4d20-ae93-b70fdeda15af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:15.598669 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036fa98-b5fa-4d20-ae93-b70fdeda15af service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:15.608529 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 374/753] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:21.093153 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef718de-8935-47ae-8292-e706b4d5576c None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:21.094077 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef718de-8935-47ae-8292-e706b4d5576c None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:21.094341 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef718de-8935-47ae-8292-e706b4d5576c None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:21.095819 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 380/754] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 19:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:21.101262 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549470f-ca74-4c03-bb12-7c4be7dedeb1 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:21.101995 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549470f-ca74-4c03-bb12-7c4be7dedeb1 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:21.102425 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549470f-ca74-4c03-bb12-7c4be7dedeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:21.141816 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-a549470f-ca74-4c03-bb12-7c4be7dedeb1 None None] MFA Rules not processed for user `43fc68da6f184762a5e7312ce37f4988`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:21.143222 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-a549470f-ca74-4c03-bb12-7c4be7dedeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:21.217108 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 375/755] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 19:10:21 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:25.212354 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=8 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:10:25.639262 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd4c61-133e-4371-aaef-e845b4024f44 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:25.639473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd4c61-133e-4371-aaef-e845b4024f44 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:25.639987 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd4c61-133e-4371-aaef-e845b4024f44 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:25.641539 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 381/756] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 19:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:25.647011 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f4e91-0c82-4d85-b10b-507ed99385b4 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:25.647495 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f4e91-0c82-4d85-b10b-507ed99385b4 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:25.647802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f4e91-0c82-4d85-b10b-507ed99385b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:25.671562 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-aa3f4e91-0c82-4d85-b10b-507ed99385b4 None None] MFA Rules not processed for user `43fc68da6f184762a5e7312ce37f4988`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:25.673046 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-aa3f4e91-0c82-4d85-b10b-507ed99385b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:25.682927 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 376/757] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 19:10:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:27.430670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa960693-3c85-4619-9c40-8c85dc2416b7 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:27.431267 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa960693-3c85-4619-9c40-8c85dc2416b7 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:27.431267 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa960693-3c85-4619-9c40-8c85dc2416b7 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:27.432895 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 382/758] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 19:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:27.438958 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800caae2-d2ce-4eec-9728-ea31c20bee1f None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:27.439473 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800caae2-d2ce-4eec-9728-ea31c20bee1f None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:27.439473 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800caae2-d2ce-4eec-9728-ea31c20bee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:27.460545 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-800caae2-d2ce-4eec-9728-ea31c20bee1f None None] MFA Rules not processed for user `43fc68da6f184762a5e7312ce37f4988`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:27.461792 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-800caae2-d2ce-4eec-9728-ea31c20bee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:27.470645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 377/759] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 19:10:27 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:31.405481 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e523d5-ce21-43b8-8d7a-fa0ab4cd07f4 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:31.405983 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e523d5-ce21-43b8-8d7a-fa0ab4cd07f4 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:31.405983 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e523d5-ce21-43b8-8d7a-fa0ab4cd07f4 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:31.407387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 383/760] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:10:31.412397 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c8ab6-71d9-4146-a219-7440495ca421 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:31.413144 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c8ab6-71d9-4146-a219-7440495ca421 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:31.413671 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c8ab6-71d9-4146-a219-7440495ca421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:31.432834 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-034c8ab6-71d9-4146-a219-7440495ca421 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:31.434534 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-034c8ab6-71d9-4146-a219-7440495ca421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:31.442347 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 378/761] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:10:31.814725 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5770bd-e334-4f6c-94cb-0a3a5e3ac648 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:31.815037 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5770bd-e334-4f6c-94cb-0a3a5e3ac648 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:31.815312 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5770bd-e334-4f6c-94cb-0a3a5e3ac648 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:31.816822 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 384/762] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 19:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:31.825092 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c399fb-0447-4a26-81c8-103fd0a731f2 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:31.825723 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c399fb-0447-4a26-81c8-103fd0a731f2 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:31.826268 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c399fb-0447-4a26-81c8-103fd0a731f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:31.869654 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-76c399fb-0447-4a26-81c8-103fd0a731f2 None None] MFA Rules not processed for user `cc6df159e6dc419cae222ebc3e5c99f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:31.871882 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-76c399fb-0447-4a26-81c8-103fd0a731f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:31.950966 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:10:31.958017 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 379/763] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 19:10:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:31.966122 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5770bd-e334-4f6c-94cb-0a3a5e3ac648 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:31.981466 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5770bd-e334-4f6c-94cb-0a3a5e3ac648 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:31.987278 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e32a33-4ec7-404e-a307-374796839924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:31.988064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e32a33-4ec7-404e-a307-374796839924 service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:31.988482 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e32a33-4ec7-404e-a307-374796839924 service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:31.988852 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e32a33-4ec7-404e-a307-374796839924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:31.999165 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e32a33-4ec7-404e-a307-374796839924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:32.001026 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e32a33-4ec7-404e-a307-374796839924 service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:32.012206 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 385/764] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:34.654435 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd845cf1-3d84-47d7-bc06-c389de1e8dfb None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:34.654960 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd845cf1-3d84-47d7-bc06-c389de1e8dfb None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:34.655186 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd845cf1-3d84-47d7-bc06-c389de1e8dfb None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:34.657381 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 380/765] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:34.662564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e077b4-8076-40b0-b3a4-95aa2a15b78b None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:34.662986 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e077b4-8076-40b0-b3a4-95aa2a15b78b None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:34.663133 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e077b4-8076-40b0-b3a4-95aa2a15b78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:34.684673 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-f9e077b4-8076-40b0-b3a4-95aa2a15b78b None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:34.685776 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-f9e077b4-8076-40b0-b3a4-95aa2a15b78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:34.695042 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 386/766] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:35.045257 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd845cf1-3d84-47d7-bc06-c389de1e8dfb None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:35.063652 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd845cf1-3d84-47d7-bc06-c389de1e8dfb None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:35.072875 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8c78d-5a49-4b89-8b8c-09041b1e7287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:35.073539 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8c78d-5a49-4b89-8b8c-09041b1e7287 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:35.073718 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8c78d-5a49-4b89-8b8c-09041b1e7287 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:35.073989 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8c78d-5a49-4b89-8b8c-09041b1e7287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:35.097468 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8c78d-5a49-4b89-8b8c-09041b1e7287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:35.100830 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8c78d-5a49-4b89-8b8c-09041b1e7287 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:35.114724 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 381/767] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:37.909589 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41f1ea-583b-4d1a-a80b-50cb1ae30d75 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:37.910056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41f1ea-583b-4d1a-a80b-50cb1ae30d75 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:37.910395 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41f1ea-583b-4d1a-a80b-50cb1ae30d75 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:37.911538 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 387/768] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:37.917493 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353c5e4-6590-41cd-8012-92940fc74e04 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:37.917950 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353c5e4-6590-41cd-8012-92940fc74e04 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:37.918458 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353c5e4-6590-41cd-8012-92940fc74e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:37.941054 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-7353c5e4-6590-41cd-8012-92940fc74e04 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:37.943365 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-7353c5e4-6590-41cd-8012-92940fc74e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:37.951986 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 382/769] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:38.306352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04f21-b925-4331-a573-a6e12d48776a None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:38.306352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04f21-b925-4331-a573-a6e12d48776a None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:38.306352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04f21-b925-4331-a573-a6e12d48776a None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:38.306352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 388/770] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 19:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:38.311422 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6c78-6bad-4496-81fa-748828f65ae4 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:38.311641 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6c78-6bad-4496-81fa-748828f65ae4 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:38.312080 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6c78-6bad-4496-81fa-748828f65ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:38.335202 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-e19d6c78-6bad-4496-81fa-748828f65ae4 None None] MFA Rules not processed for user `cc6df159e6dc419cae222ebc3e5c99f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:38.336429 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-e19d6c78-6bad-4496-81fa-748828f65ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:38.345851 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 383/771] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 19:10:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:38.355649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb04f21-b925-4331-a573-a6e12d48776a None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:38.372735 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb04f21-b925-4331-a573-a6e12d48776a None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:38.377911 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1c13d-70d2-4d0d-88bb-f96c630daf80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:38.378714 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1c13d-70d2-4d0d-88bb-f96c630daf80 service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:38.379069 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1c13d-70d2-4d0d-88bb-f96c630daf80 service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:38.379415 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1c13d-70d2-4d0d-88bb-f96c630daf80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:38.388665 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1c13d-70d2-4d0d-88bb-f96c630daf80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:38.390309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1c13d-70d2-4d0d-88bb-f96c630daf80 service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:38.413838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 389/772] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:41.012009 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf5c5-f7f6-4318-a120-e9f738c1c5f6 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:41.012614 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf5c5-f7f6-4318-a120-e9f738c1c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:41.012614 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf5c5-f7f6-4318-a120-e9f738c1c5f6 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:41.014156 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 384/773] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:41.019675 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c2093-e1b0-4b3b-a889-75ecadd1942c None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:41.020528 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c2093-e1b0-4b3b-a889-75ecadd1942c None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:41.020964 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c2093-e1b0-4b3b-a889-75ecadd1942c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:41.044766 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-666c2093-e1b0-4b3b-a889-75ecadd1942c None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:41.046293 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-666c2093-e1b0-4b3b-a889-75ecadd1942c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:41.068735 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 390/774] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:41.561877 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbf5c5-f7f6-4318-a120-e9f738c1c5f6 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:41.578286 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbf5c5-f7f6-4318-a120-e9f738c1c5f6 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:41.584294 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec39c2-b143-4719-a789-8b64f2630b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:41.584884 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec39c2-b143-4719-a789-8b64f2630b3a service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:41.585253 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec39c2-b143-4719-a789-8b64f2630b3a service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:41.585594 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec39c2-b143-4719-a789-8b64f2630b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:41.596222 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec39c2-b143-4719-a789-8b64f2630b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:41.597908 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec39c2-b143-4719-a789-8b64f2630b3a service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:41.608852 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 385/775] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:41.642588 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6043803-e6a5-4946-b47e-75b024dda247 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:41.642877 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6043803-e6a5-4946-b47e-75b024dda247 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:41.643151 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6043803-e6a5-4946-b47e-75b024dda247 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:41.644757 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 391/776] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:41.651198 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5089f-7a85-4f80-a426-40d98aadb159 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:41.653143 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5089f-7a85-4f80-a426-40d98aadb159 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:41.653634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5089f-7a85-4f80-a426-40d98aadb159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:41.675313 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-21c5089f-7a85-4f80-a426-40d98aadb159 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:41.677475 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-21c5089f-7a85-4f80-a426-40d98aadb159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:41.687193 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 386/777] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:10:42.083185 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1768a5f-1123-4d96-add0-33e8e575808e None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:42.083185 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1768a5f-1123-4d96-add0-33e8e575808e None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:42.083185 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1768a5f-1123-4d96-add0-33e8e575808e None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:42.085637 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 392/778] 10.222.0.16 () {54 vars in 963 bytes} [Thu Oct 20 19:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:42.093391 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e466f-f62c-498d-9ccf-5817286b5d38 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:42.093391 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e466f-f62c-498d-9ccf-5817286b5d38 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:42.093391 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e466f-f62c-498d-9ccf-5817286b5d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:42.130461 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-7d7e466f-f62c-498d-9ccf-5817286b5d38 None None] MFA Rules not processed for user `b3e19f1878d042b295d1f75a3a781419`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:42.131644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-7d7e466f-f62c-498d-9ccf-5817286b5d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:42.194974 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 387/779] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Oct 20 19:10:42 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:42.202722 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1768a5f-1123-4d96-add0-33e8e575808e None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:42.213294 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1768a5f-1123-4d96-add0-33e8e575808e None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:42.217509 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f330572-a526-4be4-8625-54320c435778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e19f1878d042b295d1f75a3a781419', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:42.218100 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330572-a526-4be4-8625-54320c435778 service cinder] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:42.218370 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330572-a526-4be4-8625-54320c435778 service cinder] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:42.218812 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f330572-a526-4be4-8625-54320c435778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:42.228156 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f330572-a526-4be4-8625-54320c435778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:42.230413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f330572-a526-4be4-8625-54320c435778 service cinder] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:42.240374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 393/780] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:44.099315 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f605-71d0-4a19-b9ab-584e60b7e34a None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:44.100237 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f605-71d0-4a19-b9ab-584e60b7e34a None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:44.100518 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f605-71d0-4a19-b9ab-584e60b7e34a None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:44.102124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 388/781] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:44.108294 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7a27-92a2-45ee-a014-ffeffa58ca2a None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:44.108830 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7a27-92a2-45ee-a014-ffeffa58ca2a None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:44.108830 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7a27-92a2-45ee-a014-ffeffa58ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:44.129782 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-7b3b7a27-92a2-45ee-a014-ffeffa58ca2a None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:44.131068 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-7b3b7a27-92a2-45ee-a014-ffeffa58ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:44.139636 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 394/782] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:44.476637 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f605-71d0-4a19-b9ab-584e60b7e34a None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:44.490503 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f605-71d0-4a19-b9ab-584e60b7e34a None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:44.495453 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9975581-3bf0-46f7-b140-66a78a593b83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:44.496123 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975581-3bf0-46f7-b140-66a78a593b83 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:44.496544 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975581-3bf0-46f7-b140-66a78a593b83 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:44.496808 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975581-3bf0-46f7-b140-66a78a593b83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:44.505478 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9975581-3bf0-46f7-b140-66a78a593b83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:44.507041 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9975581-3bf0-46f7-b140-66a78a593b83 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:44.516877 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 389/783] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:46.980225 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd271c-5e07-4f91-aa6a-636c3c269a4c None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:46.980823 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd271c-5e07-4f91-aa6a-636c3c269a4c None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:46.980823 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd271c-5e07-4f91-aa6a-636c3c269a4c None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:46.982108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 395/784] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:46.987715 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f77186-9bb0-40de-a941-94ae4dad2414 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:46.988138 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f77186-9bb0-40de-a941-94ae4dad2414 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:46.988259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f77186-9bb0-40de-a941-94ae4dad2414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:47.008398 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-d2f77186-9bb0-40de-a941-94ae4dad2414 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:47.009575 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-d2f77186-9bb0-40de-a941-94ae4dad2414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:47.018796 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 390/785] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:47.363326 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd271c-5e07-4f91-aa6a-636c3c269a4c None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:47.380010 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd271c-5e07-4f91-aa6a-636c3c269a4c None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:47.385044 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5d598-c35a-4320-820f-97a1e64577a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:47.385696 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5d598-c35a-4320-820f-97a1e64577a0 service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:47.386142 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5d598-c35a-4320-820f-97a1e64577a0 service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:47.386582 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5d598-c35a-4320-820f-97a1e64577a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:47.395500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5d598-c35a-4320-820f-97a1e64577a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:47.397238 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5d598-c35a-4320-820f-97a1e64577a0 service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:47.408375 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 396/786] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:49.958214 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbc8ef-9d55-466f-a17b-1ff839b2ed93 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:49.958804 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbc8ef-9d55-466f-a17b-1ff839b2ed93 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:49.958804 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbc8ef-9d55-466f-a17b-1ff839b2ed93 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:49.960341 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 391/787] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:49.966359 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901a41-4ceb-4288-90c5-1d82ecd45911 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:49.966968 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901a41-4ceb-4288-90c5-1d82ecd45911 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:49.966968 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab901a41-4ceb-4288-90c5-1d82ecd45911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:49.988914 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-ab901a41-4ceb-4288-90c5-1d82ecd45911 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:49.990180 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-ab901a41-4ceb-4288-90c5-1d82ecd45911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:50.000330 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 397/788] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:50.339369 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbc8ef-9d55-466f-a17b-1ff839b2ed93 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:50.353874 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbc8ef-9d55-466f-a17b-1ff839b2ed93 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:50.359233 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e7f63-fba4-4c82-a93b-53abe8c986f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:50.359861 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e7f63-fba4-4c82-a93b-53abe8c986f9 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:50.359861 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e7f63-fba4-4c82-a93b-53abe8c986f9 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:50.360497 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e7f63-fba4-4c82-a93b-53abe8c986f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:50.371538 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e7f63-fba4-4c82-a93b-53abe8c986f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:50.372912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e7f63-fba4-4c82-a93b-53abe8c986f9 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:50.398176 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 392/789] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:52.934630 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee871e-972e-49ce-bbb9-beb9f68ca249 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:52.936321 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee871e-972e-49ce-bbb9-beb9f68ca249 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:52.936667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee871e-972e-49ce-bbb9-beb9f68ca249 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:52.939148 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 398/790] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:52.945417 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c58b5-6c5d-4f9b-b936-1bbd68158c08 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:52.945911 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c58b5-6c5d-4f9b-b936-1bbd68158c08 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:52.946048 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c58b5-6c5d-4f9b-b936-1bbd68158c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:52.970501 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-267c58b5-6c5d-4f9b-b936-1bbd68158c08 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:52.972081 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-267c58b5-6c5d-4f9b-b936-1bbd68158c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:52.982426 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 393/791] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:53.494917 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee871e-972e-49ce-bbb9-beb9f68ca249 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:53.512930 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee871e-972e-49ce-bbb9-beb9f68ca249 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:53.519372 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d83c3c-c72e-4fdd-bcdb-897e6587df52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:53.520120 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83c3c-c72e-4fdd-bcdb-897e6587df52 service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:53.520506 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83c3c-c72e-4fdd-bcdb-897e6587df52 service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:53.520855 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83c3c-c72e-4fdd-bcdb-897e6587df52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:53.531777 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d83c3c-c72e-4fdd-bcdb-897e6587df52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:53.533862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d83c3c-c72e-4fdd-bcdb-897e6587df52 service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:53.546040 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 399/792] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:56.465242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd44e0c-7511-48bb-aa72-f29653ed5c1e None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:56.465931 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd44e0c-7511-48bb-aa72-f29653ed5c1e None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:56.465931 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd44e0c-7511-48bb-aa72-f29653ed5c1e None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:56.467107 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 394/793] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:56.472501 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bec902-a221-418f-b734-a84a12d46b41 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:56.473019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bec902-a221-418f-b734-a84a12d46b41 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:56.473019 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bec902-a221-418f-b734-a84a12d46b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:56.480292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=43 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:10:56.492785 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-b4bec902-a221-418f-b734-a84a12d46b41 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:56.493971 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-b4bec902-a221-418f-b734-a84a12d46b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:56.501884 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 400/794] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:56.851247 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd44e0c-7511-48bb-aa72-f29653ed5c1e None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:56.864996 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd44e0c-7511-48bb-aa72-f29653ed5c1e None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:56.869882 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f6e88-6bf8-4632-9e39-8324d9682b0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:56.870660 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f6e88-6bf8-4632-9e39-8324d9682b0a service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:56.870936 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f6e88-6bf8-4632-9e39-8324d9682b0a service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:56.871213 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f6e88-6bf8-4632-9e39-8324d9682b0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:56.879246 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f6e88-6bf8-4632-9e39-8324d9682b0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:56.880853 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f6e88-6bf8-4632-9e39-8324d9682b0a service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:56.890248 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 395/795] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:58.464722 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cf2b4-4f91-46ea-a49d-c04aeecef7df None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:58.465376 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cf2b4-4f91-46ea-a49d-c04aeecef7df None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:58.465376 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cf2b4-4f91-46ea-a49d-c04aeecef7df None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:58.466579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 401/796] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:58.471942 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265577cc-297f-49bc-b9fc-5bc873aca360 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:58.472437 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265577cc-297f-49bc-b9fc-5bc873aca360 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:58.472627 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265577cc-297f-49bc-b9fc-5bc873aca360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:58.491757 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-265577cc-297f-49bc-b9fc-5bc873aca360 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:58.492946 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-265577cc-297f-49bc-b9fc-5bc873aca360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:58.501187 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 396/797] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:58.851021 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0473b6-9ad5-4e71-83e6-9385110b5a4d None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:58.851301 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0473b6-9ad5-4e71-83e6-9385110b5a4d None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:58.851568 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0473b6-9ad5-4e71-83e6-9385110b5a4d None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:58.852908 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 402/798] 10.222.0.16 () {54 vars in 962 bytes} [Thu Oct 20 19:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:10:58.858291 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4b943-e53c-4ce8-a642-065bf941d15f None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:58.858669 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4b943-e53c-4ce8-a642-065bf941d15f None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:58.859003 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4b943-e53c-4ce8-a642-065bf941d15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:58.902168 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-83c4b943-e53c-4ce8-a642-065bf941d15f None None] MFA Rules not processed for user `3b28a7b6a48d48f5a23741ad142c93ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:58.903390 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-83c4b943-e53c-4ce8-a642-065bf941d15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:58.924485 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:10:58.964466 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 397/799] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Oct 20 19:10:58 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:10:58.972075 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0473b6-9ad5-4e71-83e6-9385110b5a4d None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:58.982690 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0473b6-9ad5-4e71-83e6-9385110b5a4d None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:58.986123 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937bc5d-15e7-40a2-b545-1b01172aa5a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b28a7b6a48d48f5a23741ad142c93ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:58.986709 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937bc5d-15e7-40a2-b545-1b01172aa5a3 service glance] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:58.986984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937bc5d-15e7-40a2-b545-1b01172aa5a3 service glance] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:58.987252 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937bc5d-15e7-40a2-b545-1b01172aa5a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:58.996631 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937bc5d-15e7-40a2-b545-1b01172aa5a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:58.998042 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937bc5d-15e7-40a2-b545-1b01172aa5a3 service glance] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:59.007725 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 403/800] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:10:59.310408 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a416b26-e92c-47e3-bdf9-aa5fab16f77c None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:59.310693 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a416b26-e92c-47e3-bdf9-aa5fab16f77c None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:59.310971 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a416b26-e92c-47e3-bdf9-aa5fab16f77c None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:59.312384 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 398/801] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:10:59.317736 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f558c0-dbef-4f7e-91a9-c826c924333e None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:59.318024 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f558c0-dbef-4f7e-91a9-c826c924333e None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:59.318320 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f558c0-dbef-4f7e-91a9-c826c924333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:59.345576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-c0f558c0-dbef-4f7e-91a9-c826c924333e None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:10:59.347004 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-c0f558c0-dbef-4f7e-91a9-c826c924333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:10:59.360226 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 404/802] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:10:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:10:59.712730 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a416b26-e92c-47e3-bdf9-aa5fab16f77c None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:10:59.727071 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a416b26-e92c-47e3-bdf9-aa5fab16f77c None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:10:59.734814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af6108-2d93-4654-97dd-d5ff0c34592e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:10:59.735424 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af6108-2d93-4654-97dd-d5ff0c34592e service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:10:59.735699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af6108-2d93-4654-97dd-d5ff0c34592e service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:10:59.735969 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af6108-2d93-4654-97dd-d5ff0c34592e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:10:59.744664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af6108-2d93-4654-97dd-d5ff0c34592e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:10:59.746523 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af6108-2d93-4654-97dd-d5ff0c34592e service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:10:59.756354 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 399/803] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:10:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:02.334584 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca0d16-16b9-483e-8c20-804b9d1896bb None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:02.337352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca0d16-16b9-483e-8c20-804b9d1896bb None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:02.337352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca0d16-16b9-483e-8c20-804b9d1896bb None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:02.337352 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 405/804] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:02.342583 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381ad53-1e5f-4c13-825d-dcafdc9b2905 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:02.343052 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381ad53-1e5f-4c13-825d-dcafdc9b2905 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:02.343151 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381ad53-1e5f-4c13-825d-dcafdc9b2905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:02.363246 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-0381ad53-1e5f-4c13-825d-dcafdc9b2905 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:02.364476 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-0381ad53-1e5f-4c13-825d-dcafdc9b2905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:02.375971 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 400/805] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:11:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:02.731639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca0d16-16b9-483e-8c20-804b9d1896bb None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:02.745718 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca0d16-16b9-483e-8c20-804b9d1896bb None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:02.750524 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac56e6c-5881-44ef-8620-6d6a2edbe2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:02.751138 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac56e6c-5881-44ef-8620-6d6a2edbe2b9 service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:02.751409 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac56e6c-5881-44ef-8620-6d6a2edbe2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:02.751674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac56e6c-5881-44ef-8620-6d6a2edbe2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:02.762703 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac56e6c-5881-44ef-8620-6d6a2edbe2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:02.764301 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac56e6c-5881-44ef-8620-6d6a2edbe2b9 service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:02.773978 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 406/806] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:05.446417 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212b945-9788-49d7-9018-644de2e53255 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:05.447087 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212b945-9788-49d7-9018-644de2e53255 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:05.447087 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212b945-9788-49d7-9018-644de2e53255 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:05.448337 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 401/807] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:05.453734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caa442-977a-4876-9ca9-25347304af45 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:05.454289 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caa442-977a-4876-9ca9-25347304af45 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:05.454289 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caa442-977a-4876-9ca9-25347304af45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:05.474374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-56caa442-977a-4876-9ca9-25347304af45 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:05.477721 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-56caa442-977a-4876-9ca9-25347304af45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:05.487263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 407/808] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:11:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:05.833524 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212b945-9788-49d7-9018-644de2e53255 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:05.847842 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212b945-9788-49d7-9018-644de2e53255 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:05.853604 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf36fa-f1c2-4a39-b527-054213f3d9fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:05.853604 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf36fa-f1c2-4a39-b527-054213f3d9fb service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:05.853604 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf36fa-f1c2-4a39-b527-054213f3d9fb service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:05.853954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf36fa-f1c2-4a39-b527-054213f3d9fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:05.862992 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf36fa-f1c2-4a39-b527-054213f3d9fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:05.864591 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf36fa-f1c2-4a39-b527-054213f3d9fb service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:05.874036 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 402/809] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:14.362689 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185391f-5932-4f07-90fb-f2a965cebc50 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:14.363308 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185391f-5932-4f07-90fb-f2a965cebc50 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:14.363308 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185391f-5932-4f07-90fb-f2a965cebc50 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:14.364583 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 408/810] 10.222.0.16 () {54 vars in 918 bytes} [Thu Oct 20 19:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:14.369838 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98422c-5fa8-44b7-bb47-c8685e2cc849 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:14.370321 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98422c-5fa8-44b7-bb47-c8685e2cc849 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:14.370430 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98422c-5fa8-44b7-bb47-c8685e2cc849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:14.390838 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-aa98422c-5fa8-44b7-bb47-c8685e2cc849 None None] MFA Rules not processed for user `43fc68da6f184762a5e7312ce37f4988`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:14.392000 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-aa98422c-5fa8-44b7-bb47-c8685e2cc849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:14.400172 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 403/811] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Oct 20 19:11:14 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:14.415195 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2bd6-7c15-4a47-9a03-946298ed800c None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:14.415474 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2bd6-7c15-4a47-9a03-946298ed800c None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:14.415742 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2bd6-7c15-4a47-9a03-946298ed800c None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:14.417172 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 409/812] 10.222.0.16 () {54 vars in 918 bytes} [Thu Oct 20 19:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:14.421701 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a9ec-892c-49a8-912d-19e8154c619c None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:14.421975 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a9ec-892c-49a8-912d-19e8154c619c None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:14.422237 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a9ec-892c-49a8-912d-19e8154c619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:14.441454 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-c564a9ec-892c-49a8-912d-19e8154c619c None None] MFA Rules not processed for user `cc6df159e6dc419cae222ebc3e5c99f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:14.442631 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-c564a9ec-892c-49a8-912d-19e8154c619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:14.451440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 404/813] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Oct 20 19:11:14 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:11:15.469065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=20 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:11:17.265060 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b02ad-2677-4d2a-967e-1c4f876fe8fe None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:17.265726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b02ad-2677-4d2a-967e-1c4f876fe8fe None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:17.265726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b02ad-2677-4d2a-967e-1c4f876fe8fe None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:17.266891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 410/814] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:17.271970 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f09c25-aa87-49fd-930f-530e60561f36 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:17.272391 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f09c25-aa87-49fd-930f-530e60561f36 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:17.272549 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f09c25-aa87-49fd-930f-530e60561f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:17.292431 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-52f09c25-aa87-49fd-930f-530e60561f36 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:17.293612 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-52f09c25-aa87-49fd-930f-530e60561f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:17.301143 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 405/815] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:11:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:17.640376 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b02ad-2677-4d2a-967e-1c4f876fe8fe None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:17.654175 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b02ad-2677-4d2a-967e-1c4f876fe8fe None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:17.659045 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34121c6e-88c6-4efa-a60c-3f7a41dd175b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:17.659625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121c6e-88c6-4efa-a60c-3f7a41dd175b service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:17.659898 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121c6e-88c6-4efa-a60c-3f7a41dd175b service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:17.660165 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121c6e-88c6-4efa-a60c-3f7a41dd175b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:17.668824 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34121c6e-88c6-4efa-a60c-3f7a41dd175b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:17.670393 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34121c6e-88c6-4efa-a60c-3f7a41dd175b service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:17.679604 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 411/816] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:19.399283 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbf495-d3bb-4fcf-889a-e65931882c73 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:19.399852 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbf495-d3bb-4fcf-889a-e65931882c73 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:19.399975 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbf495-d3bb-4fcf-889a-e65931882c73 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:19.401436 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 406/817] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:19.406239 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44cb6b-99a0-49cb-976c-755a25e0bb74 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:19.406685 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44cb6b-99a0-49cb-976c-755a25e0bb74 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:19.406790 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44cb6b-99a0-49cb-976c-755a25e0bb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:19.426276 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-4e44cb6b-99a0-49cb-976c-755a25e0bb74 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:19.427474 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-4e44cb6b-99a0-49cb-976c-755a25e0bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:19.435513 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 412/818] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:11:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:19.645038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbf495-d3bb-4fcf-889a-e65931882c73 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:19.658461 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbf495-d3bb-4fcf-889a-e65931882c73 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:19.663565 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde52326-8886-4b63-ba49-c1e3eddc45ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:19.664155 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde52326-8886-4b63-ba49-c1e3eddc45ef service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:19.664465 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde52326-8886-4b63-ba49-c1e3eddc45ef service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:19.664740 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde52326-8886-4b63-ba49-c1e3eddc45ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:19.673314 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde52326-8886-4b63-ba49-c1e3eddc45ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:19.674918 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde52326-8886-4b63-ba49-c1e3eddc45ef service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:19.684691 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 407/819] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:21.359046 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614db14-3f94-48ee-b50d-c4ce94a34c42 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:21.359638 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614db14-3f94-48ee-b50d-c4ce94a34c42 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:21.359638 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614db14-3f94-48ee-b50d-c4ce94a34c42 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:21.360972 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 413/820] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:11:21.365996 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3327c46-eb5c-44bf-9f90-a9aa18672f24 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:21.366447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3327c46-eb5c-44bf-9f90-a9aa18672f24 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:21.366561 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3327c46-eb5c-44bf-9f90-a9aa18672f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:21.388500 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-d3327c46-eb5c-44bf-9f90-a9aa18672f24 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:21.389673 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-d3327c46-eb5c-44bf-9f90-a9aa18672f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:21.397338 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 408/821] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:11:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:21.554641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614db14-3f94-48ee-b50d-c4ce94a34c42 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:21.568245 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614db14-3f94-48ee-b50d-c4ce94a34c42 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:21.573674 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc3add-d273-45ed-a52b-354dc7dfe5e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:21.574255 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3add-d273-45ed-a52b-354dc7dfe5e5 service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:21.574528 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3add-d273-45ed-a52b-354dc7dfe5e5 service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:21.574795 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc3add-d273-45ed-a52b-354dc7dfe5e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:21.582572 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc3add-d273-45ed-a52b-354dc7dfe5e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:21.584118 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc3add-d273-45ed-a52b-354dc7dfe5e5 service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:21.593476 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 414/822] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:23.261772 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394fe9c-e06c-4440-a7fc-7add379801ed None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:23.262339 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394fe9c-e06c-4440-a7fc-7add379801ed None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:23.262339 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394fe9c-e06c-4440-a7fc-7add379801ed None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:23.263639 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 409/823] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:23.268518 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5810f-eb3b-4da7-a911-8491c60765a0 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:23.268956 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5810f-eb3b-4da7-a911-8491c60765a0 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:23.269069 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5810f-eb3b-4da7-a911-8491c60765a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:23.288832 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-f7a5810f-eb3b-4da7-a911-8491c60765a0 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:23.290007 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-f7a5810f-eb3b-4da7-a911-8491c60765a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:23.297571 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 415/824] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:11:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:23.453277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394fe9c-e06c-4440-a7fc-7add379801ed None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:23.467060 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394fe9c-e06c-4440-a7fc-7add379801ed None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:23.471830 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222032a7-304e-4e65-8dc9-4c1c6a89bf80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:23.472444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222032a7-304e-4e65-8dc9-4c1c6a89bf80 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:23.472716 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222032a7-304e-4e65-8dc9-4c1c6a89bf80 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:23.472980 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222032a7-304e-4e65-8dc9-4c1c6a89bf80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:23.481075 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222032a7-304e-4e65-8dc9-4c1c6a89bf80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:23.482634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222032a7-304e-4e65-8dc9-4c1c6a89bf80 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:23.491696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 410/825] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:25.143703 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f06d8-56f0-492a-8a9f-a4b265fe2557 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:25.144296 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f06d8-56f0-492a-8a9f-a4b265fe2557 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:25.144296 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f06d8-56f0-492a-8a9f-a4b265fe2557 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:25.145484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 416/826] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:25.150339 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757eaf-1cb8-47bf-92e1-504f62f38a38 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:25.150765 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757eaf-1cb8-47bf-92e1-504f62f38a38 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:25.150961 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757eaf-1cb8-47bf-92e1-504f62f38a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:25.170107 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-eb757eaf-1cb8-47bf-92e1-504f62f38a38 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:25.171283 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-eb757eaf-1cb8-47bf-92e1-504f62f38a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:25.178897 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 411/827] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:11:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:25.335891 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f06d8-56f0-492a-8a9f-a4b265fe2557 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:25.349742 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f06d8-56f0-492a-8a9f-a4b265fe2557 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:25.355258 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082825d-a944-43b4-892d-aa4242f7a95a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:25.355841 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082825d-a944-43b4-892d-aa4242f7a95a service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:25.356122 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082825d-a944-43b4-892d-aa4242f7a95a service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:25.356431 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082825d-a944-43b4-892d-aa4242f7a95a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:25.364285 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082825d-a944-43b4-892d-aa4242f7a95a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:25.365842 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082825d-a944-43b4-892d-aa4242f7a95a service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:25.375111 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 417/828] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:26.973607 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf0f7-647b-47f6-a506-ce3e96b54bac None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:26.974124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf0f7-647b-47f6-a506-ce3e96b54bac None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:26.974124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf0f7-647b-47f6-a506-ce3e96b54bac None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:26.975417 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 412/829] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:26.980951 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ec38-0f6e-46d8-90a0-5f264d74de72 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:26.981378 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ec38-0f6e-46d8-90a0-5f264d74de72 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:26.981512 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ec38-0f6e-46d8-90a0-5f264d74de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:27.001047 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-8591ec38-0f6e-46d8-90a0-5f264d74de72 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:27.002226 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-8591ec38-0f6e-46d8-90a0-5f264d74de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:27.009988 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 418/830] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:11:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:27.168118 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf0f7-647b-47f6-a506-ce3e96b54bac None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:27.181954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf0f7-647b-47f6-a506-ce3e96b54bac None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:27.187230 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5bf21-6fea-45e7-ad63-67126beab758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:27.187812 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5bf21-6fea-45e7-ad63-67126beab758 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:27.188089 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5bf21-6fea-45e7-ad63-67126beab758 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:27.188420 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5bf21-6fea-45e7-ad63-67126beab758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:27.196299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5bf21-6fea-45e7-ad63-67126beab758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:27.197873 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5bf21-6fea-45e7-ad63-67126beab758 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:27.206893 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 413/831] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:28.814595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00666-c8d5-4697-bfbe-30b8e7fd48e0 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:28.815148 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00666-c8d5-4697-bfbe-30b8e7fd48e0 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:28.815148 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec00666-c8d5-4697-bfbe-30b8e7fd48e0 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:28.816484 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 419/832] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:28.821443 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c993-6d0b-4fae-b109-d3ed3b6ec5ba None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:28.821815 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c993-6d0b-4fae-b109-d3ed3b6ec5ba None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:28.821985 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98c993-6d0b-4fae-b109-d3ed3b6ec5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:28.841218 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-9a98c993-6d0b-4fae-b109-d3ed3b6ec5ba None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:28.842393 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-9a98c993-6d0b-4fae-b109-d3ed3b6ec5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:28.850009 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 414/833] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:11:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:29.007850 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec00666-c8d5-4697-bfbe-30b8e7fd48e0 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:29.021657 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec00666-c8d5-4697-bfbe-30b8e7fd48e0 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:29.026587 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b81cb5-c656-4ed8-8550-1ebd0ac52c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:29.027172 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81cb5-c656-4ed8-8550-1ebd0ac52c03 service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:29.027449 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81cb5-c656-4ed8-8550-1ebd0ac52c03 service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:29.027715 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b81cb5-c656-4ed8-8550-1ebd0ac52c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:29.035542 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b81cb5-c656-4ed8-8550-1ebd0ac52c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:29.037131 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b81cb5-c656-4ed8-8550-1ebd0ac52c03 service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:29.046453 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 420/834] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:30.650205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe6fdf-2d79-4b11-b589-e864a5d2651f None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:30.650793 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe6fdf-2d79-4b11-b589-e864a5d2651f None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:30.650793 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe6fdf-2d79-4b11-b589-e864a5d2651f None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:30.652257 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 415/835] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:30.657190 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182465c-f290-4005-906e-7c122caec710 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:30.657576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182465c-f290-4005-906e-7c122caec710 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:30.657728 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182465c-f290-4005-906e-7c122caec710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:30.677043 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-b182465c-f290-4005-906e-7c122caec710 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:30.678206 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-b182465c-f290-4005-906e-7c122caec710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:30.686305 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 421/836] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:11:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:11:30.841729 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe6fdf-2d79-4b11-b589-e864a5d2651f None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:30.849129 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=67 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:11:30.856067 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe6fdf-2d79-4b11-b589-e864a5d2651f None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:30.860950 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d5f49-df25-4734-9a5a-b1b3c12de3b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:30.861526 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5f49-df25-4734-9a5a-b1b3c12de3b3 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:30.861803 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5f49-df25-4734-9a5a-b1b3c12de3b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:30.862075 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5f49-df25-4734-9a5a-b1b3c12de3b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:30.870074 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d5f49-df25-4734-9a5a-b1b3c12de3b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:30.871647 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d5f49-df25-4734-9a5a-b1b3c12de3b3 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:30.880863 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 416/837] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:32.490820 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af26e50-4d72-4bbc-ba35-82cffefe1c39 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:32.491361 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af26e50-4d72-4bbc-ba35-82cffefe1c39 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:32.491361 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af26e50-4d72-4bbc-ba35-82cffefe1c39 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:32.492640 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 422/838] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:32.498103 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069754de-f88c-4df5-8dc4-52940b77838f None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:32.498509 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069754de-f88c-4df5-8dc4-52940b77838f None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:32.498643 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069754de-f88c-4df5-8dc4-52940b77838f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:32.517615 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-069754de-f88c-4df5-8dc4-52940b77838f None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:32.518789 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-069754de-f88c-4df5-8dc4-52940b77838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:32.526645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 417/839] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:11:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:32.685398 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af26e50-4d72-4bbc-ba35-82cffefe1c39 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:32.699099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af26e50-4d72-4bbc-ba35-82cffefe1c39 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:32.704009 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d77d1-e592-40a0-bd07-7d0a4c4a3617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:32.704657 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d77d1-e592-40a0-bd07-7d0a4c4a3617 service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:32.704929 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d77d1-e592-40a0-bd07-7d0a4c4a3617 service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:32.705198 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d77d1-e592-40a0-bd07-7d0a4c4a3617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:32.713144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d77d1-e592-40a0-bd07-7d0a4c4a3617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:32.715397 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d77d1-e592-40a0-bd07-7d0a4c4a3617 service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:32.724362 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 423/840] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:35.089605 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce75c67-28fd-45f5-9423-0036c3f5dfd0 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:35.090145 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce75c67-28fd-45f5-9423-0036c3f5dfd0 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:35.090463 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce75c67-28fd-45f5-9423-0036c3f5dfd0 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:35.092912 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 418/841] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:11:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:35.098234 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67ffd-d99e-4d57-ac54-3fecd3808588 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:35.098640 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67ffd-d99e-4d57-ac54-3fecd3808588 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:35.098767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67ffd-d99e-4d57-ac54-3fecd3808588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:35.118116 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-69e67ffd-d99e-4d57-ac54-3fecd3808588 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:35.119309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-69e67ffd-d99e-4d57-ac54-3fecd3808588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:35.127889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 424/842] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:11:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:35.469640 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce75c67-28fd-45f5-9423-0036c3f5dfd0 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:35.481033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce75c67-28fd-45f5-9423-0036c3f5dfd0 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:35.484651 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0777cc3-91fa-4671-b625-d4c8e1bf9c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:35.485373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0777cc3-91fa-4671-b625-d4c8e1bf9c96 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:35.485644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0777cc3-91fa-4671-b625-d4c8e1bf9c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:35.485906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0777cc3-91fa-4671-b625-d4c8e1bf9c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:35.495540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0777cc3-91fa-4671-b625-d4c8e1bf9c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:35.496995 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0777cc3-91fa-4671-b625-d4c8e1bf9c96 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:35.506736 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 419/843] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:38.069884 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01986ddf-c1c0-413a-bad3-b73fa29016b1 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:38.070468 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01986ddf-c1c0-413a-bad3-b73fa29016b1 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:38.070468 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01986ddf-c1c0-413a-bad3-b73fa29016b1 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:38.071651 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 425/844] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:38.076911 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9feb7-e6a1-4cb6-a799-9c383f72b35e None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:38.077327 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9feb7-e6a1-4cb6-a799-9c383f72b35e None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:38.077427 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9feb7-e6a1-4cb6-a799-9c383f72b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:38.097077 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-34d9feb7-e6a1-4cb6-a799-9c383f72b35e None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:38.098259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-34d9feb7-e6a1-4cb6-a799-9c383f72b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:38.106442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 420/845] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:11:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:38.443461 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01986ddf-c1c0-413a-bad3-b73fa29016b1 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:38.454321 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01986ddf-c1c0-413a-bad3-b73fa29016b1 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:38.457723 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78250f3b-b529-4985-a4d2-d880861ad22c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:38.458297 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250f3b-b529-4985-a4d2-d880861ad22c service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:38.458570 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250f3b-b529-4985-a4d2-d880861ad22c service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:38.458833 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250f3b-b529-4985-a4d2-d880861ad22c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:38.468031 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78250f3b-b529-4985-a4d2-d880861ad22c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:38.469481 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78250f3b-b529-4985-a4d2-d880861ad22c service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:38.478711 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 426/846] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:41.252645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e77ce-936d-4ce9-8be8-b91ab5cc8bed None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:41.253180 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e77ce-936d-4ce9-8be8-b91ab5cc8bed None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:41.253286 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e77ce-936d-4ce9-8be8-b91ab5cc8bed None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:41.254559 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 421/847] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:41.260473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6cdc-7db9-42e4-a2fe-49e777c147f1 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:41.261001 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6cdc-7db9-42e4-a2fe-49e777c147f1 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:41.261142 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6cdc-7db9-42e4-a2fe-49e777c147f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:41.281073 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-26cc6cdc-7db9-42e4-a2fe-49e777c147f1 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:41.282321 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-26cc6cdc-7db9-42e4-a2fe-49e777c147f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:41.290313 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 427/848] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:11:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:41.628909 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e77ce-936d-4ce9-8be8-b91ab5cc8bed None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:41.640147 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e77ce-936d-4ce9-8be8-b91ab5cc8bed None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:41.643644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf0be3-e519-4f83-933a-c03aa2ba8882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:41.644222 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf0be3-e519-4f83-933a-c03aa2ba8882 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:41.644523 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf0be3-e519-4f83-933a-c03aa2ba8882 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:41.644787 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf0be3-e519-4f83-933a-c03aa2ba8882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:41.654031 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf0be3-e519-4f83-933a-c03aa2ba8882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:41.655433 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf0be3-e519-4f83-933a-c03aa2ba8882 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:41.664801 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 422/849] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:44.183307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83df71-cf22-4bd1-8660-5e927fbf61e8 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:44.183833 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83df71-cf22-4bd1-8660-5e927fbf61e8 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:44.183833 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83df71-cf22-4bd1-8660-5e927fbf61e8 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:44.185100 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 428/850] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:44.190249 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e895ed7-0b1f-41c5-8a08-e20528079195 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:44.190677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e895ed7-0b1f-41c5-8a08-e20528079195 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:44.190781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e895ed7-0b1f-41c5-8a08-e20528079195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:44.210328 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-2e895ed7-0b1f-41c5-8a08-e20528079195 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:44.211510 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-2e895ed7-0b1f-41c5-8a08-e20528079195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:44.219447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 423/851] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:11:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:44.560543 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83df71-cf22-4bd1-8660-5e927fbf61e8 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:44.571274 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83df71-cf22-4bd1-8660-5e927fbf61e8 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:44.575001 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b00d9-dd7c-4e54-8e79-b310d1731e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:44.575593 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b00d9-dd7c-4e54-8e79-b310d1731e5c service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:44.575868 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b00d9-dd7c-4e54-8e79-b310d1731e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:44.576134 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b00d9-dd7c-4e54-8e79-b310d1731e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:44.584958 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b00d9-dd7c-4e54-8e79-b310d1731e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:44.586365 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b00d9-dd7c-4e54-8e79-b310d1731e5c service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:44.596087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 429/852] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:47.037112 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ced84-5d2a-4509-9e2d-a52af65c7b8e None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:47.037644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ced84-5d2a-4509-9e2d-a52af65c7b8e None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:47.037644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ced84-5d2a-4509-9e2d-a52af65c7b8e None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:47.039215 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 424/853] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:47.045017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34301ed-d134-464b-9b9f-a50684e7352c None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:47.045413 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34301ed-d134-464b-9b9f-a50684e7352c None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:47.045542 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34301ed-d134-464b-9b9f-a50684e7352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:47.052736 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=61 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:11:47.065742 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-c34301ed-d134-464b-9b9f-a50684e7352c None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:47.066923 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-c34301ed-d134-464b-9b9f-a50684e7352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:47.075017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 430/854] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:11:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:47.415523 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ced84-5d2a-4509-9e2d-a52af65c7b8e None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:47.426481 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ced84-5d2a-4509-9e2d-a52af65c7b8e None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:47.429935 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2c683-7cd2-4a16-85b8-7701f955d3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:47.430512 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c683-7cd2-4a16-85b8-7701f955d3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:47.430783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c683-7cd2-4a16-85b8-7701f955d3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:47.431046 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c683-7cd2-4a16-85b8-7701f955d3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:47.440198 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2c683-7cd2-4a16-85b8-7701f955d3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:47.441706 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2c683-7cd2-4a16-85b8-7701f955d3d3 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:47.451713 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 425/855] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:49.995964 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fb945-2bf8-40f4-96bc-e0faef8e1fc3 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:49.996516 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fb945-2bf8-40f4-96bc-e0faef8e1fc3 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:49.996516 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fb945-2bf8-40f4-96bc-e0faef8e1fc3 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:49.997781 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 431/856] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:50.003603 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ee8c-0306-4bb9-92f1-031cfd398c39 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:50.004388 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ee8c-0306-4bb9-92f1-031cfd398c39 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:50.004388 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ee8c-0306-4bb9-92f1-031cfd398c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:50.025380 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-d876ee8c-0306-4bb9-92f1-031cfd398c39 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:50.027109 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-d876ee8c-0306-4bb9-92f1-031cfd398c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:50.035728 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 426/857] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:11:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:50.414299 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fb945-2bf8-40f4-96bc-e0faef8e1fc3 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:50.424890 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fb945-2bf8-40f4-96bc-e0faef8e1fc3 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:50.428335 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57714c0-7fac-4dd1-8d90-fbdc2c8e2d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:50.428922 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57714c0-7fac-4dd1-8d90-fbdc2c8e2d58 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:50.429195 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57714c0-7fac-4dd1-8d90-fbdc2c8e2d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:50.429461 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57714c0-7fac-4dd1-8d90-fbdc2c8e2d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:50.438437 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57714c0-7fac-4dd1-8d90-fbdc2c8e2d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:50.439890 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57714c0-7fac-4dd1-8d90-fbdc2c8e2d58 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:50.449963 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 432/858] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:52.905014 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b465b4d-d243-4dd4-a191-32fc694a993e None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:52.905540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b465b4d-d243-4dd4-a191-32fc694a993e None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:52.905540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b465b4d-d243-4dd4-a191-32fc694a993e None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:52.906875 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 427/859] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:52.912068 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8251e4-31d6-433e-8a1b-5347572a91bf None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:52.912551 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8251e4-31d6-433e-8a1b-5347572a91bf None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:52.912646 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8251e4-31d6-433e-8a1b-5347572a91bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:52.932343 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-be8251e4-31d6-433e-8a1b-5347572a91bf None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:52.933531 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-be8251e4-31d6-433e-8a1b-5347572a91bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:52.941320 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 433/860] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:11:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:53.282066 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b465b4d-d243-4dd4-a191-32fc694a993e None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:53.293381 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b465b4d-d243-4dd4-a191-32fc694a993e None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:53.296821 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b73f56-1b6d-43de-9322-4b842f88d630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:53.297403 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b73f56-1b6d-43de-9322-4b842f88d630 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:53.297678 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b73f56-1b6d-43de-9322-4b842f88d630 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:53.297943 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b73f56-1b6d-43de-9322-4b842f88d630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:53.307262 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b73f56-1b6d-43de-9322-4b842f88d630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:53.308819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b73f56-1b6d-43de-9322-4b842f88d630 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:53.317930 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 428/861] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:55.765507 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac4528-2a22-49fa-92cd-f8f5bc573701 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:55.766024 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac4528-2a22-49fa-92cd-f8f5bc573701 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:55.766024 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac4528-2a22-49fa-92cd-f8f5bc573701 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:55.767343 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 434/862] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:55.772509 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419787-7e7c-4a7c-9adf-2f44150e00fe None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:55.772895 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419787-7e7c-4a7c-9adf-2f44150e00fe None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:55.773051 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419787-7e7c-4a7c-9adf-2f44150e00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:55.792742 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-7f419787-7e7c-4a7c-9adf-2f44150e00fe None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:55.793921 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-7f419787-7e7c-4a7c-9adf-2f44150e00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:55.801559 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 429/863] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:11:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:56.145665 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac4528-2a22-49fa-92cd-f8f5bc573701 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:56.156251 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac4528-2a22-49fa-92cd-f8f5bc573701 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:56.159702 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e8b1f-0510-4d84-9d6d-92af0743dd38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:56.160312 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e8b1f-0510-4d84-9d6d-92af0743dd38 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:56.160591 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e8b1f-0510-4d84-9d6d-92af0743dd38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:56.160857 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e8b1f-0510-4d84-9d6d-92af0743dd38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:56.170373 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e8b1f-0510-4d84-9d6d-92af0743dd38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:56.171779 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e8b1f-0510-4d84-9d6d-92af0743dd38 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:56.180883 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 435/864] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:11:58.647926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89cd7e-c195-4932-aaea-c9f5fae7c281 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:58.648499 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89cd7e-c195-4932-aaea-c9f5fae7c281 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:58.648499 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89cd7e-c195-4932-aaea-c9f5fae7c281 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:58.649743 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 430/865] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:11:58.655175 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6641a0-b8a4-4335-956a-865292d8c1b2 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:58.655594 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6641a0-b8a4-4335-956a-865292d8c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:58.655709 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6641a0-b8a4-4335-956a-865292d8c1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:58.675003 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-bb6641a0-b8a4-4335-956a-865292d8c1b2 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:11:58.676167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-bb6641a0-b8a4-4335-956a-865292d8c1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:11:58.684389 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 436/866] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:11:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:11:59.014534 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89cd7e-c195-4932-aaea-c9f5fae7c281 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:11:59.025568 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89cd7e-c195-4932-aaea-c9f5fae7c281 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:11:59.029051 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc0b0a-217c-4ab9-be86-25cd3593c7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:11:59.029629 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc0b0a-217c-4ab9-be86-25cd3593c7ff service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:11:59.029897 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc0b0a-217c-4ab9-be86-25cd3593c7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:11:59.030160 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc0b0a-217c-4ab9-be86-25cd3593c7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:11:59.038920 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc0b0a-217c-4ab9-be86-25cd3593c7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:11:59.040387 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc0b0a-217c-4ab9-be86-25cd3593c7ff service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:11:59.049891 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 431/867] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:11:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:12:01.455662 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b433-bd70-466c-bb7f-1729fee8cf62 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:01.456185 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b433-bd70-466c-bb7f-1729fee8cf62 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:01.456185 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b433-bd70-466c-bb7f-1729fee8cf62 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:01.457562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 437/868] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:12:01.463487 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9921f7-1f4f-412f-8346-e6022b6ba0f2 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:01.463915 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9921f7-1f4f-412f-8346-e6022b6ba0f2 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:01.464102 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9921f7-1f4f-412f-8346-e6022b6ba0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:01.471512 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=51 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:12:01.484113 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-9d9921f7-1f4f-412f-8346-e6022b6ba0f2 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:12:01.485321 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-9d9921f7-1f4f-412f-8346-e6022b6ba0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:12:01.493039 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 432/869] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:12:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:12:01.831250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b433-bd70-466c-bb7f-1729fee8cf62 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:12:01.842930 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b433-bd70-466c-bb7f-1729fee8cf62 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:12:01.846350 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7335f32-6112-427d-985c-ac7135d55a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:12:01.846930 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7335f32-6112-427d-985c-ac7135d55a8b service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:01.847198 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7335f32-6112-427d-985c-ac7135d55a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:01.847459 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7335f32-6112-427d-985c-ac7135d55a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:01.856699 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7335f32-6112-427d-985c-ac7135d55a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:12:01.858094 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7335f32-6112-427d-985c-ac7135d55a8b service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:12:01.867041 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 438/870] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:12:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:12:11.479431 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=2 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:12:11.863178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=26 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:12:26.342555 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc755283-06b8-4178-b107-687d12d848dc None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:26.343138 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc755283-06b8-4178-b107-687d12d848dc None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:26.343138 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc755283-06b8-4178-b107-687d12d848dc None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:26.344518 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 433/871] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:12:26.349539 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001651-ad19-47c1-a77d-3989d69513ee None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:26.349997 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001651-ad19-47c1-a77d-3989d69513ee None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:26.350106 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001651-ad19-47c1-a77d-3989d69513ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:26.370039 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-a8001651-ad19-47c1-a77d-3989d69513ee None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:12:26.371216 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-a8001651-ad19-47c1-a77d-3989d69513ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:12:26.378925 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 439/872] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:12:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:12:26.729536 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75773efb-5f9e-47bf-8f41-066fd3323937 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:26.729819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75773efb-5f9e-47bf-8f41-066fd3323937 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:26.730086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75773efb-5f9e-47bf-8f41-066fd3323937 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:26.731396 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 434/873] 10.222.0.16 () {54 vars in 962 bytes} [Thu Oct 20 19:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:12:26.736670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c160d-5e09-441c-8d95-a1be4561308b None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:26.736952 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c160d-5e09-441c-8d95-a1be4561308b None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:26.737246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c160d-5e09-441c-8d95-a1be4561308b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:26.756753 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-370c160d-5e09-441c-8d95-a1be4561308b None None] MFA Rules not processed for user `3b28a7b6a48d48f5a23741ad142c93ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:12:26.757921 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-370c160d-5e09-441c-8d95-a1be4561308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:12:26.764665 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 440/874] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Oct 20 19:12:26 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:12:26.771922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75773efb-5f9e-47bf-8f41-066fd3323937 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:12:26.782235 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75773efb-5f9e-47bf-8f41-066fd3323937 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:12:26.785636 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe9b13-23db-4612-bbd0-305a324e5132 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b28a7b6a48d48f5a23741ad142c93ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:12:26.786215 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe9b13-23db-4612-bbd0-305a324e5132 service glance] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:26.786478 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe9b13-23db-4612-bbd0-305a324e5132 service glance] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:26.786739 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe9b13-23db-4612-bbd0-305a324e5132 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:26.796741 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe9b13-23db-4612-bbd0-305a324e5132 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:12:26.798160 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe9b13-23db-4612-bbd0-305a324e5132 service glance] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:12:26.807897 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 435/875] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:12:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:12:29.310523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fcb8a-97c3-406c-b1e8-7281573eb9e5 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:29.311089 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fcb8a-97c3-406c-b1e8-7281573eb9e5 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:29.311089 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fcb8a-97c3-406c-b1e8-7281573eb9e5 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:29.312417 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 441/876] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:12:29.317911 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642385f-9990-40f7-95f2-32da2a6e0a9b None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:29.318384 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642385f-9990-40f7-95f2-32da2a6e0a9b None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:29.318490 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642385f-9990-40f7-95f2-32da2a6e0a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:29.338317 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-4642385f-9990-40f7-95f2-32da2a6e0a9b None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:12:29.339578 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-4642385f-9990-40f7-95f2-32da2a6e0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:12:29.347223 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 436/877] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:12:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:12:29.675621 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fcb8a-97c3-406c-b1e8-7281573eb9e5 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:12:29.688789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fcb8a-97c3-406c-b1e8-7281573eb9e5 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:12:29.693473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717c827-4cbb-4886-96d4-6c58b7031175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:12:29.694057 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717c827-4cbb-4886-96d4-6c58b7031175 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:29.694325 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717c827-4cbb-4886-96d4-6c58b7031175 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:29.694584 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717c827-4cbb-4886-96d4-6c58b7031175 admin admin] PATH_INFO: `/v3/projects` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:29.695214 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717c827-4cbb-4886-96d4-6c58b7031175 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:12:29.696882 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: WARNING py.warnings [None req-9717c827-4cbb-4886-96d4-6c58b7031175 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:12:29.696882 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: warnings.warn(msg) Oct 20 19:12:29.696882 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: Oct 20 19:12:29.698007 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717c827-4cbb-4886-96d4-6c58b7031175 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:12:29.716210 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 442/878] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Oct 20 19:12:29 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:12:32.150504 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a060-eaca-486a-ad5b-2aff1dadfa82 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:32.150985 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a060-eaca-486a-ad5b-2aff1dadfa82 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:32.151129 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a060-eaca-486a-ad5b-2aff1dadfa82 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:32.152394 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 437/879] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:12:32.157886 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8461fc-0320-4bd9-afde-ecdac33be754 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:32.158326 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8461fc-0320-4bd9-afde-ecdac33be754 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:32.158433 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8461fc-0320-4bd9-afde-ecdac33be754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:32.178311 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-1a8461fc-0320-4bd9-afde-ecdac33be754 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:12:32.179504 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-1a8461fc-0320-4bd9-afde-ecdac33be754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:12:32.187377 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 443/880] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:12:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:12:32.537319 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250a060-eaca-486a-ad5b-2aff1dadfa82 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:12:32.551377 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250a060-eaca-486a-ad5b-2aff1dadfa82 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:12:32.556868 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae927f1a-5641-4f7a-bd11-ce9db7d52da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:12:32.557444 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae927f1a-5641-4f7a-bd11-ce9db7d52da7 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:32.557715 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae927f1a-5641-4f7a-bd11-ce9db7d52da7 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:32.557979 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae927f1a-5641-4f7a-bd11-ce9db7d52da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:32.565819 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae927f1a-5641-4f7a-bd11-ce9db7d52da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:12:32.567373 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae927f1a-5641-4f7a-bd11-ce9db7d52da7 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:12:32.576474 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 438/881] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:12:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:12:35.169863 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bffe3f-6bc6-4457-80aa-e9c631dd3ffe None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:35.170391 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bffe3f-6bc6-4457-80aa-e9c631dd3ffe None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:35.170391 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bffe3f-6bc6-4457-80aa-e9c631dd3ffe None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:35.171625 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 444/882] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:12:35.176810 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632106a0-a29c-4543-a2f7-6275f2219a43 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:35.177324 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632106a0-a29c-4543-a2f7-6275f2219a43 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:35.177421 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632106a0-a29c-4543-a2f7-6275f2219a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:35.196757 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-632106a0-a29c-4543-a2f7-6275f2219a43 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:12:35.197941 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-632106a0-a29c-4543-a2f7-6275f2219a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:12:35.205642 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 439/883] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:12:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:12:35.547760 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bffe3f-6bc6-4457-80aa-e9c631dd3ffe None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:12:35.558889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bffe3f-6bc6-4457-80aa-e9c631dd3ffe None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:12:35.562376 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f346b4-b021-4406-97ef-f28a13a61260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:12:35.562960 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f346b4-b021-4406-97ef-f28a13a61260 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:35.563237 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f346b4-b021-4406-97ef-f28a13a61260 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:35.563506 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f346b4-b021-4406-97ef-f28a13a61260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:35.572191 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f346b4-b021-4406-97ef-f28a13a61260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:12:35.573631 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f346b4-b021-4406-97ef-f28a13a61260 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:12:35.582959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 445/884] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:12:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:12:38.018116 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a5547-975b-4da6-864d-b01c63049337 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:38.018675 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a5547-975b-4da6-864d-b01c63049337 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:38.018675 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a5547-975b-4da6-864d-b01c63049337 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:38.019896 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 440/885] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:12:38.025701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb45f52-221e-4eeb-9629-dcbe56210b5e None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:38.026135 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb45f52-221e-4eeb-9629-dcbe56210b5e None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:38.026247 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb45f52-221e-4eeb-9629-dcbe56210b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:38.045547 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-bbb45f52-221e-4eeb-9629-dcbe56210b5e None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:12:38.046718 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-bbb45f52-221e-4eeb-9629-dcbe56210b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:12:38.054221 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 446/886] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:12:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:12:38.394347 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a5547-975b-4da6-864d-b01c63049337 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:12:38.404749 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a5547-975b-4da6-864d-b01c63049337 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:12:38.408484 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc27e23-1d74-4094-ab01-484145d1777d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:12:38.409072 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc27e23-1d74-4094-ab01-484145d1777d service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:38.409348 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc27e23-1d74-4094-ab01-484145d1777d service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:38.409616 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc27e23-1d74-4094-ab01-484145d1777d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:38.419462 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc27e23-1d74-4094-ab01-484145d1777d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:12:38.420913 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc27e23-1d74-4094-ab01-484145d1777d service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:12:38.431117 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 441/887] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:12:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:12:40.980992 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195199f2-014c-4b48-aca9-03f128332308 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:40.981543 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195199f2-014c-4b48-aca9-03f128332308 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:40.981543 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195199f2-014c-4b48-aca9-03f128332308 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:40.982766 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 447/888] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:12:40.988074 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79261915-8d90-4a0a-9309-1db334486fd6 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:40.988543 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79261915-8d90-4a0a-9309-1db334486fd6 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:40.988659 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79261915-8d90-4a0a-9309-1db334486fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:41.008260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-79261915-8d90-4a0a-9309-1db334486fd6 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:12:41.009450 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-79261915-8d90-4a0a-9309-1db334486fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:12:41.016951 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 442/889] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:12:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:12:41.356761 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195199f2-014c-4b48-aca9-03f128332308 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:12:41.367478 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195199f2-014c-4b48-aca9-03f128332308 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:12:41.370990 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733e484-0eee-40f9-b19f-ae5bdb725d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:12:41.371570 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733e484-0eee-40f9-b19f-ae5bdb725d8f service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:41.371842 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733e484-0eee-40f9-b19f-ae5bdb725d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:41.372103 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733e484-0eee-40f9-b19f-ae5bdb725d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:41.381733 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733e484-0eee-40f9-b19f-ae5bdb725d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:12:41.384023 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733e484-0eee-40f9-b19f-ae5bdb725d8f service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:12:41.394231 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 448/890] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:12:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:12:43.985367 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dc3c8-8fe5-4f90-853d-2af8b56e366d None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:43.985890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dc3c8-8fe5-4f90-853d-2af8b56e366d None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:43.985890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dc3c8-8fe5-4f90-853d-2af8b56e366d None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:43.987158 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 443/891] 10.222.0.16 () {54 vars in 927 bytes} [Thu Oct 20 19:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:12:43.993002 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef08c5c-6b52-46d8-b2df-f6d956f97654 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:43.993447 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef08c5c-6b52-46d8-b2df-f6d956f97654 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:43.993549 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef08c5c-6b52-46d8-b2df-f6d956f97654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:44.012731 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-7ef08c5c-6b52-46d8-b2df-f6d956f97654 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:12:44.013914 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-7ef08c5c-6b52-46d8-b2df-f6d956f97654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:12:44.021510 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 449/892] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Oct 20 19:12:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:12:44.363744 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dc3c8-8fe5-4f90-853d-2af8b56e366d None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:12:44.375671 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dc3c8-8fe5-4f90-853d-2af8b56e366d None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:12:44.379442 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810f5a0-f513-4385-8ae4-8749244d77e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:12:44.380166 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f5a0-f513-4385-8ae4-8749244d77e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:12:44.380567 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f5a0-f513-4385-8ae4-8749244d77e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:12:44.380951 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f5a0-f513-4385-8ae4-8749244d77e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:12:44.389911 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810f5a0-f513-4385-8ae4-8749244d77e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:12:44.391325 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810f5a0-f513-4385-8ae4-8749244d77e3 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:12:44.400482 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 444/893] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:12:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:12:54.008010 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=33 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:12:54.396550 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=33 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:13:59.278831 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298680-278b-465f-a779-37e0b8cab317 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.279461 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298680-278b-465f-a779-37e0b8cab317 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.279461 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298680-278b-465f-a779-37e0b8cab317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.298889 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-fd298680-278b-465f-a779-37e0b8cab317 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:13:59.300084 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-fd298680-278b-465f-a779-37e0b8cab317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:13:59.307949 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 450/894] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:13:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:13:59.315860 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c69130-83f9-46c7-b7a5-ff9c8609ac53 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.316899 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c69130-83f9-46c7-b7a5-ff9c8609ac53 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.317008 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c69130-83f9-46c7-b7a5-ff9c8609ac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.337133 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-a7c69130-83f9-46c7-b7a5-ff9c8609ac53 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:13:59.338312 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-a7c69130-83f9-46c7-b7a5-ff9c8609ac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:13:59.345965 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 445/895] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:13:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:13:59.350590 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd298680-278b-465f-a779-37e0b8cab317 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:13:59.360182 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd298680-278b-465f-a779-37e0b8cab317 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:13:59.364774 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdabc4-0a99-454e-94ba-0895937f8a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:13:59.365369 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdabc4-0a99-454e-94ba-0895937f8a1a admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.365645 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdabc4-0a99-454e-94ba-0895937f8a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.365915 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdabc4-0a99-454e-94ba-0895937f8a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.366556 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdabc4-0a99-454e-94ba-0895937f8a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:13:59.366861 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdabc4-0a99-454e-94ba-0895937f8a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:13:59.367867 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: WARNING py.warnings [None req-c0bdabc4-0a99-454e-94ba-0895937f8a1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:13:59.367867 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: warnings.warn(msg) Oct 20 19:13:59.367867 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: Oct 20 19:13:59.368814 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdabc4-0a99-454e-94ba-0895937f8a1a admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:13:59.380788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 451/896] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 19:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:13:59.389954 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c69130-83f9-46c7-b7a5-ff9c8609ac53 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:13:59.399435 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c69130-83f9-46c7-b7a5-ff9c8609ac53 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:13:59.403938 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b8c5-ab57-4de7-8735-6d56ddc989f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:13:59.404552 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b8c5-ab57-4de7-8735-6d56ddc989f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.404823 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b8c5-ab57-4de7-8735-6d56ddc989f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.405086 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b8c5-ab57-4de7-8735-6d56ddc989f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.405700 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676b8c5-ab57-4de7-8735-6d56ddc989f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:13:59.406783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: WARNING py.warnings [None req-7676b8c5-ab57-4de7-8735-6d56ddc989f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:13:59.406783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: warnings.warn(msg) Oct 20 19:13:59.406783 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: Oct 20 19:13:59.407950 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676b8c5-ab57-4de7-8735-6d56ddc989f1 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:13:59.435589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 446/897] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 19:13:59 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:13:59.439924 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdabc4-0a99-454e-94ba-0895937f8a1a admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:13:59.450497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdabc4-0a99-454e-94ba-0895937f8a1a admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:13:59.506640 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ac4b8-f4aa-4db8-93a2-92075267d3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:13:59.507231 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac4b8-f4aa-4db8-93a2-92075267d3bc admin admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.507504 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac4b8-f4aa-4db8-93a2-92075267d3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.507766 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac4b8-f4aa-4db8-93a2-92075267d3bc admin admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.508421 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ac4b8-f4aa-4db8-93a2-92075267d3bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:13:59.509405 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: WARNING py.warnings [None req-214ac4b8-f4aa-4db8-93a2-92075267d3bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:13:59.509405 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: warnings.warn(msg) Oct 20 19:13:59.509405 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: Oct 20 19:13:59.510595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ac4b8-f4aa-4db8-93a2-92075267d3bc admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:13:59.532590 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 452/898] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:13:59 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:13:59.536710 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b8c5-ab57-4de7-8735-6d56ddc989f1 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:13:59.546942 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b8c5-ab57-4de7-8735-6d56ddc989f1 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:13:59.552107 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7fc2b-050e-4632-afbb-5102421d125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:13:59.552725 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7fc2b-050e-4632-afbb-5102421d125b admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.552994 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7fc2b-050e-4632-afbb-5102421d125b admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.553255 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7fc2b-050e-4632-afbb-5102421d125b admin admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.553902 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7fc2b-050e-4632-afbb-5102421d125b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:13:59.555500 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7fc2b-050e-4632-afbb-5102421d125b admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:13:59.568372 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 447/899] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 19:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:13:59.572214 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ac4b8-f4aa-4db8-93a2-92075267d3bc admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:13:59.581830 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ac4b8-f4aa-4db8-93a2-92075267d3bc admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:13:59.586591 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6ecca-d3ff-43ff-bec6-dacd60236d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:13:59.587172 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6ecca-d3ff-43ff-bec6-dacd60236d4e admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.587445 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6ecca-d3ff-43ff-bec6-dacd60236d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.587713 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6ecca-d3ff-43ff-bec6-dacd60236d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.588377 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6ecca-d3ff-43ff-bec6-dacd60236d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:13:59.589960 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6ecca-d3ff-43ff-bec6-dacd60236d4e admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:13:59.603050 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 453/900] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 19:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:13:59.607327 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7fc2b-050e-4632-afbb-5102421d125b admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:13:59.617508 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7fc2b-050e-4632-afbb-5102421d125b admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:13:59.622095 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10133f5-e77a-425f-a03c-9a6c9faaf091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:13:59.622727 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10133f5-e77a-425f-a03c-9a6c9faaf091 admin admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.622996 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10133f5-e77a-425f-a03c-9a6c9faaf091 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.623269 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10133f5-e77a-425f-a03c-9a6c9faaf091 admin admin] PATH_INFO: `/v3/projects/ee8c3ca382bf432b8beff477d286eebc/users/8fd227acfa0f48b3adce9803ac0858af/roles/bbdc52113ece4f3da0ee37763b27b9e5` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.637911 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10133f5-e77a-425f-a03c-9a6c9faaf091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8c3ca382bf432b8beff477d286eebc, user_id=8fd227acfa0f48b3adce9803ac0858af, role_id=bbdc52113ece4f3da0ee37763b27b9e5)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:13:59.640639 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10133f5-e77a-425f-a03c-9a6c9faaf091 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:13:59.653234 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 448/901] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 19:13:59 2022] PUT /identity/v3/projects/ee8c3ca382bf432b8beff477d286eebc/users/8fd227acfa0f48b3adce9803ac0858af/roles/bbdc52113ece4f3da0ee37763b27b9e5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:13:59.664783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eddf3-9b98-4f9f-8551-af15e75d5007 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.665070 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eddf3-9b98-4f9f-8551-af15e75d5007 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.665340 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eddf3-9b98-4f9f-8551-af15e75d5007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.693734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-017eddf3-9b98-4f9f-8551-af15e75d5007 None None] MFA Rules not processed for user `8fd227acfa0f48b3adce9803ac0858af`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:13:59.694921 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-017eddf3-9b98-4f9f-8551-af15e75d5007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:13:59.755802 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 454/902] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:13:59 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:13:59.768990 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd7d6-cbce-405c-ad54-f6c570bbc50a None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.769267 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd7d6-cbce-405c-ad54-f6c570bbc50a None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.770020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd7d6-cbce-405c-ad54-f6c570bbc50a None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.771341 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 449/903] 10.222.0.16 () {54 vars in 963 bytes} [Thu Oct 20 19:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:13:59.776167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a0644-f7b8-40c7-b3a1-b17abedb90f9 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.776490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a0644-f7b8-40c7-b3a1-b17abedb90f9 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.776789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a0644-f7b8-40c7-b3a1-b17abedb90f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.796755 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-632a0644-f7b8-40c7-b3a1-b17abedb90f9 None None] MFA Rules not processed for user `b3e19f1878d042b295d1f75a3a781419`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:13:59.797850 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-632a0644-f7b8-40c7-b3a1-b17abedb90f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:13:59.840477 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:13:59.849047 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 455/904] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Oct 20 19:13:59 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:13:59.856589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bd7d6-cbce-405c-ad54-f6c570bbc50a None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:13:59.867618 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bd7d6-cbce-405c-ad54-f6c570bbc50a None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:13:59.871036 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17fbda-d3c3-4e89-bf32-0542ce22ac14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e19f1878d042b295d1f75a3a781419', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:13:59.871611 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17fbda-d3c3-4e89-bf32-0542ce22ac14 service cinder] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.871882 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17fbda-d3c3-4e89-bf32-0542ce22ac14 service cinder] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.872146 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17fbda-d3c3-4e89-bf32-0542ce22ac14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.880788 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17fbda-d3c3-4e89-bf32-0542ce22ac14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:13:59.882191 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17fbda-d3c3-4e89-bf32-0542ce22ac14 service cinder] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:13:59.890517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 450/905] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:13:59 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:13:59.930466 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fef1ac-f7fe-4cf0-af40-db4308d23358 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:13:59.930748 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fef1ac-f7fe-4cf0-af40-db4308d23358 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:13:59.931016 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fef1ac-f7fe-4cf0-af40-db4308d23358 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:13:59.932255 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 456/906] 10.222.0.16 () {52 vars in 830 bytes} [Thu Oct 20 19:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:13:59.935787 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17fbda-d3c3-4e89-bf32-0542ce22ac14 service cinder] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:13:59.995814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17fbda-d3c3-4e89-bf32-0542ce22ac14 service cinder] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:14:00.000261 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:14:00.000886 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:14:00.001158 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:14:00.001422 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] PATH_INFO: `/v3/users/8fd227acfa0f48b3adce9803ac0858af` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:14:00.002525 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd227acfa0f48b3adce9803ac0858af)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:14:00.003524 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: WARNING py.warnings [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:14:00.003524 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: warnings.warn(msg) Oct 20 19:14:00.003524 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: Oct 20 19:14:00.005339 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:14:00.069675 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd227acfa0f48b3adce9803ac0858af'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:14:00.083795 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd227acfa0f48b3adce9803ac0858af'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:14:00.084476 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd227acfa0f48b3adce9803ac0858af'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:14:00.085188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd227acfa0f48b3adce9803ac0858af'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:14:00.094483 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd227acfa0f48b3adce9803ac0858af'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:14:00.122594 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 451/907] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 19:13:59 2022] DELETE /identity/v3/users/8fd227acfa0f48b3adce9803ac0858af => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:14:00.127049 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234d2bf-2297-4d53-b45c-2a57a7ee9b19 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:14:00.127403 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234d2bf-2297-4d53-b45c-2a57a7ee9b19 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:14:00.127745 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234d2bf-2297-4d53-b45c-2a57a7ee9b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:14:00.146744 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-6234d2bf-2297-4d53-b45c-2a57a7ee9b19 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:14:00.147925 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-6234d2bf-2297-4d53-b45c-2a57a7ee9b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:14:00.205959 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 457/908] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:14:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:14:00.216237 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:14:00.217642 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:14:00.223438 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:14:00.276813 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda6363-7ac9-4a1c-92c1-887d75bbd166 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:14:00.280433 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62655c6-b3fc-4e18-ae2e-2e4a061af61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:14:00.281029 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62655c6-b3fc-4e18-ae2e-2e4a061af61f service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:14:00.281339 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62655c6-b3fc-4e18-ae2e-2e4a061af61f service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:14:00.281562 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62655c6-b3fc-4e18-ae2e-2e4a061af61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:14:00.290586 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62655c6-b3fc-4e18-ae2e-2e4a061af61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:14:00.291987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62655c6-b3fc-4e18-ae2e-2e4a061af61f service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:14:00.301806 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 452/909] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:14:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:14:00.654823 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234d2bf-2297-4d53-b45c-2a57a7ee9b19 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:14:00.656255 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-6234d2bf-2297-4d53-b45c-2a57a7ee9b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:14:00.668925 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234d2bf-2297-4d53-b45c-2a57a7ee9b19 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:14:00.674812 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:14:00.675452 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:14:00.675757 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:14:00.676178 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] PATH_INFO: `/v3/projects/ee8c3ca382bf432b8beff477d286eebc` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:14:00.677309 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8c3ca382bf432b8beff477d286eebc)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:14:00.679017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: WARNING py.warnings [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:14:00.679017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: warnings.warn(msg) Oct 20 19:14:00.679017 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: Oct 20 19:14:00.680443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:14:00.744634 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8c3ca382bf432b8beff477d286eebc', 'request_id': 'req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:14:00.758445 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8c3ca382bf432b8beff477d286eebc', 'request_id': 'req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:14:00.767910 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8c3ca382bf432b8beff477d286eebc', 'request_id': 'req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:14:00.779373 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] The token cache is being invalidate because project ee8c3ca382bf432b8beff477d286eebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88308) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 19:14:00.779662 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:14:00.780314 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-9ec962f4-c8e5-4cff-9ad7-ceb77e3a5b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:14:00.781935 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 458/910] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 19:14:00 2022] DELETE /identity/v3/projects/ee8c3ca382bf432b8beff477d286eebc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:14:10.297014 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=25 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:14:10.776448 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:15:22.158741 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12c690-c238-4b1a-b938-c38d21378f06 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:22.159303 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12c690-c238-4b1a-b938-c38d21378f06 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:22.159303 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12c690-c238-4b1a-b938-c38d21378f06 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:22.160568 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 453/911] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:15:22.165656 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ccef8-77b7-43d3-b0c0-683576c7a94e None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:22.166157 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ccef8-77b7-43d3-b0c0-683576c7a94e None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:22.166271 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ccef8-77b7-43d3-b0c0-683576c7a94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:22.234926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-cb9ccef8-77b7-43d3-b0c0-683576c7a94e None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:15:22.236131 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-cb9ccef8-77b7-43d3-b0c0-683576c7a94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:22.329636 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 459/912] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:15:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:15:22.486522 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12c690-c238-4b1a-b938-c38d21378f06 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:15:22.488901 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-cc12c690-c238-4b1a-b938-c38d21378f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:22.575059 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12c690-c238-4b1a-b938-c38d21378f06 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:15:22.579921 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce1d39-21ff-4170-b75b-78a233d1ac5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:15:22.580536 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce1d39-21ff-4170-b75b-78a233d1ac5c service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:22.580811 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce1d39-21ff-4170-b75b-78a233d1ac5c service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:22.581078 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce1d39-21ff-4170-b75b-78a233d1ac5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:22.589334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce1d39-21ff-4170-b75b-78a233d1ac5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:15:22.590889 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce1d39-21ff-4170-b75b-78a233d1ac5c service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:15:22.600388 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 454/913] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:15:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:15:24.233633 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883505-b236-4d0e-863b-80bc738f162d None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:24.234198 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883505-b236-4d0e-863b-80bc738f162d None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:24.234198 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b883505-b236-4d0e-863b-80bc738f162d None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:24.235514 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 460/914] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:15:24.240217 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101cf43-fdb3-492d-acd8-766a15a02013 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:24.240664 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101cf43-fdb3-492d-acd8-766a15a02013 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:24.240764 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101cf43-fdb3-492d-acd8-766a15a02013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:24.259781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-4101cf43-fdb3-492d-acd8-766a15a02013 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:15:24.260983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-4101cf43-fdb3-492d-acd8-766a15a02013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:24.268507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 455/915] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:15:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:15:24.426553 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b883505-b236-4d0e-863b-80bc738f162d None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:15:24.441882 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b883505-b236-4d0e-863b-80bc738f162d None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:15:24.446796 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4651dc-dd92-4cd1-a4f0-e9b55ce29f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:15:24.447386 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4651dc-dd92-4cd1-a4f0-e9b55ce29f6b service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:24.447663 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4651dc-dd92-4cd1-a4f0-e9b55ce29f6b service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:24.447934 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4651dc-dd92-4cd1-a4f0-e9b55ce29f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:24.455921 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4651dc-dd92-4cd1-a4f0-e9b55ce29f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:15:24.458188 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4651dc-dd92-4cd1-a4f0-e9b55ce29f6b service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:15:24.467339 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 461/916] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:15:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 19:15:27.859124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41146a80-294a-46ab-b785-fe527ef76c22 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:27.859667 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41146a80-294a-46ab-b785-fe527ef76c22 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:27.859667 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41146a80-294a-46ab-b785-fe527ef76c22 None None] PATH_INFO: `/v3` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:27.860962 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 456/917] 10.222.0.23 () {54 vars in 925 bytes} [Thu Oct 20 19:15:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:15:27.866902 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2cf7a-d1df-4955-9b52-0b36b88b2aa5 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:27.867312 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2cf7a-d1df-4955-9b52-0b36b88b2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:27.867443 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2cf7a-d1df-4955-9b52-0b36b88b2aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:27.897473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-97e2cf7a-d1df-4955-9b52-0b36b88b2aa5 None None] MFA Rules not processed for user `43fc68da6f184762a5e7312ce37f4988`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:15:27.898667 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-97e2cf7a-d1df-4955-9b52-0b36b88b2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:27.953305 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:15:27.963434 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 462/918] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Oct 20 19:15:27 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:15:34.255318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=42 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:15:36.503418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e096882-ac9c-4634-a8a3-a950564a7719 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:36.504044 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e096882-ac9c-4634-a8a3-a950564a7719 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:36.504044 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e096882-ac9c-4634-a8a3-a950564a7719 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:36.505528 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 457/919] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:15:36.510629 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69229c-1dce-45f6-a0fd-0a12b4e17f10 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:36.511074 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69229c-1dce-45f6-a0fd-0a12b4e17f10 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:36.511208 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69229c-1dce-45f6-a0fd-0a12b4e17f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:36.531510 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-1b69229c-1dce-45f6-a0fd-0a12b4e17f10 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:15:36.532749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-1b69229c-1dce-45f6-a0fd-0a12b4e17f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:36.541932 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 463/920] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:15:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:15:36.711179 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e096882-ac9c-4634-a8a3-a950564a7719 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:15:36.725847 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e096882-ac9c-4634-a8a3-a950564a7719 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:15:36.731207 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925eb570-fcc1-4c5d-9205-3de7bf80ad63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:15:36.731796 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb570-fcc1-4c5d-9205-3de7bf80ad63 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:36.732064 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb570-fcc1-4c5d-9205-3de7bf80ad63 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:36.732360 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925eb570-fcc1-4c5d-9205-3de7bf80ad63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:36.741055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eb570-fcc1-4c5d-9205-3de7bf80ad63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:15:36.742635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925eb570-fcc1-4c5d-9205-3de7bf80ad63 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:15:36.755117 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 458/921] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:15:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:15:36.902600 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4fc49-bfd5-4fbe-80ef-49299f759bce None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:36.902887 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4fc49-bfd5-4fbe-80ef-49299f759bce None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:36.903190 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4fc49-bfd5-4fbe-80ef-49299f759bce None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:36.904564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 464/922] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 19:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:15:36.910079 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b41c-eda5-47ac-9285-4289f2f112f0 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:36.910371 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b41c-eda5-47ac-9285-4289f2f112f0 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:36.911067 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b41c-eda5-47ac-9285-4289f2f112f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:36.932169 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-d835b41c-eda5-47ac-9285-4289f2f112f0 None None] MFA Rules not processed for user `43fc68da6f184762a5e7312ce37f4988`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:15:36.933403 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-d835b41c-eda5-47ac-9285-4289f2f112f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:36.942836 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 459/923] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 19:15:36 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:15:36.950174 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4fc49-bfd5-4fbe-80ef-49299f759bce None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:15:36.963767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4fc49-bfd5-4fbe-80ef-49299f759bce None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:15:36.968782 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05102525-1448-4665-8302-ad13f09b98aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43fc68da6f184762a5e7312ce37f4988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:15:36.969374 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05102525-1448-4665-8302-ad13f09b98aa service placement] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:36.969650 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05102525-1448-4665-8302-ad13f09b98aa service placement] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:36.969918 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05102525-1448-4665-8302-ad13f09b98aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:36.978512 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05102525-1448-4665-8302-ad13f09b98aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:15:36.980086 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05102525-1448-4665-8302-ad13f09b98aa service placement] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:15:36.990570 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 465/924] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:15:36 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:15:38.407886 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c491c14-6ce0-4860-9cca-2cd5b57d4850 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:38.408449 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c491c14-6ce0-4860-9cca-2cd5b57d4850 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:38.408449 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c491c14-6ce0-4860-9cca-2cd5b57d4850 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:38.409794 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 460/925] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 19:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:15:38.415500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e8d52-eabc-4468-b032-ed60060e3601 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:38.415892 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e8d52-eabc-4468-b032-ed60060e3601 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:38.416041 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e8d52-eabc-4468-b032-ed60060e3601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:38.435792 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-503e8d52-eabc-4468-b032-ed60060e3601 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:15:38.437008 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-503e8d52-eabc-4468-b032-ed60060e3601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:38.444773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 466/926] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 19:15:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:15:38.604361 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c491c14-6ce0-4860-9cca-2cd5b57d4850 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:15:38.618628 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c491c14-6ce0-4860-9cca-2cd5b57d4850 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:15:38.623513 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e447fd-338f-489f-80b6-1274c2498a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:15:38.624089 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e447fd-338f-489f-80b6-1274c2498a2f service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:38.624395 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e447fd-338f-489f-80b6-1274c2498a2f service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:38.624688 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e447fd-338f-489f-80b6-1274c2498a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:38.633687 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e447fd-338f-489f-80b6-1274c2498a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:15:38.635246 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e447fd-338f-489f-80b6-1274c2498a2f service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:15:38.644357 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 461/927] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:15:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:15:42.883910 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2b171-9b95-487e-b5e7-f91ea6b0a465 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:42.884473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2b171-9b95-487e-b5e7-f91ea6b0a465 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:42.884473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2b171-9b95-487e-b5e7-f91ea6b0a465 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:42.885788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 467/928] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:15:42.890995 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aac5c-d77a-4174-a997-dd87b05a572d None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:42.891425 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aac5c-d77a-4174-a997-dd87b05a572d None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:42.891532 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aac5c-d77a-4174-a997-dd87b05a572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:42.912018 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-a92aac5c-d77a-4174-a997-dd87b05a572d None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:15:42.913238 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-a92aac5c-d77a-4174-a997-dd87b05a572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:42.920868 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 462/929] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:15:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:15:43.256636 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2b171-9b95-487e-b5e7-f91ea6b0a465 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:15:43.258342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-79f2b171-9b95-487e-b5e7-f91ea6b0a465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:43.317194 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2b171-9b95-487e-b5e7-f91ea6b0a465 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:15:43.320669 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3d1b2-92db-4767-920b-cf634bac6a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:15:43.321255 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3d1b2-92db-4767-920b-cf634bac6a25 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:43.321526 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3d1b2-92db-4767-920b-cf634bac6a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:43.321795 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3d1b2-92db-4767-920b-cf634bac6a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:43.330387 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3d1b2-92db-4767-920b-cf634bac6a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:15:43.331783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3d1b2-92db-4767-920b-cf634bac6a25 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:15:43.340893 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 468/930] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:15:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:15:45.707909 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4b2da-ce9e-4536-a90a-73d407cee948 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:45.708516 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4b2da-ce9e-4536-a90a-73d407cee948 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:45.708516 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4b2da-ce9e-4536-a90a-73d407cee948 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:45.709822 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 463/931] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:15:45.715250 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f4cab-b77d-44b8-a0bf-5cc13e974dcb None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:45.715657 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f4cab-b77d-44b8-a0bf-5cc13e974dcb None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:45.715826 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f4cab-b77d-44b8-a0bf-5cc13e974dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:45.736886 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-ea3f4cab-b77d-44b8-a0bf-5cc13e974dcb None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:15:45.738651 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-ea3f4cab-b77d-44b8-a0bf-5cc13e974dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:45.746871 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 469/932] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:15:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:15:46.092631 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4b2da-ce9e-4536-a90a-73d407cee948 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:15:46.103739 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4b2da-ce9e-4536-a90a-73d407cee948 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:15:46.107204 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9174b5-1f2f-42a3-97ba-bc4fa846cf4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:15:46.107777 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9174b5-1f2f-42a3-97ba-bc4fa846cf4c service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:46.108047 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9174b5-1f2f-42a3-97ba-bc4fa846cf4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:46.108340 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9174b5-1f2f-42a3-97ba-bc4fa846cf4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:46.116874 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9174b5-1f2f-42a3-97ba-bc4fa846cf4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:15:46.118279 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9174b5-1f2f-42a3-97ba-bc4fa846cf4c service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:15:46.127220 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 464/933] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:15:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:15:50.113763 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f8f6-abf9-4b88-ae93-ab2965070cc0 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:50.114678 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f8f6-abf9-4b88-ae93-ab2965070cc0 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:50.114678 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f8f6-abf9-4b88-ae93-ab2965070cc0 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:50.116188 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 470/934] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:15:50.121383 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882042-95d2-461d-a922-66eb5cfa3e7c None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:50.121802 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882042-95d2-461d-a922-66eb5cfa3e7c None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:50.121906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74882042-95d2-461d-a922-66eb5cfa3e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:50.141151 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-74882042-95d2-461d-a922-66eb5cfa3e7c None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:15:50.142313 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-74882042-95d2-461d-a922-66eb5cfa3e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:50.150514 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 465/935] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:15:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:15:50.505427 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11f8f6-abf9-4b88-ae93-ab2965070cc0 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:15:50.507082 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-8a11f8f6-abf9-4b88-ae93-ab2965070cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:50.562858 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11f8f6-abf9-4b88-ae93-ab2965070cc0 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:15:50.566962 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bfa60-66f6-4370-bd1d-e707b3cd6510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e19f1878d042b295d1f75a3a781419', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:15:50.567550 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bfa60-66f6-4370-bd1d-e707b3cd6510 service cinder] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:50.567821 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bfa60-66f6-4370-bd1d-e707b3cd6510 service cinder] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:50.568089 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bfa60-66f6-4370-bd1d-e707b3cd6510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:50.576882 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bfa60-66f6-4370-bd1d-e707b3cd6510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:15:50.578277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bfa60-66f6-4370-bd1d-e707b3cd6510 service cinder] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:15:50.587714 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 471/936] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:15:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:15:52.982316 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a7eb3-f669-456f-b3f8-8c6571631610 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:52.982877 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a7eb3-f669-456f-b3f8-8c6571631610 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:52.982877 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a7eb3-f669-456f-b3f8-8c6571631610 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:52.984219 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 466/937] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 19:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:15:52.990043 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18fb71-0244-4bc2-9806-aec5f7971943 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:52.990470 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18fb71-0244-4bc2-9806-aec5f7971943 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:52.990582 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18fb71-0244-4bc2-9806-aec5f7971943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:53.010127 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-8f18fb71-0244-4bc2-9806-aec5f7971943 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:15:53.011291 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-8f18fb71-0244-4bc2-9806-aec5f7971943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:53.018804 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 472/938] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 19:15:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:15:53.372002 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a7eb3-f669-456f-b3f8-8c6571631610 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:15:53.373734 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-d37a7eb3-f669-456f-b3f8-8c6571631610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:15:53.387044 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a7eb3-f669-456f-b3f8-8c6571631610 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:15:53.390513 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483786a1-8123-4c17-bde4-0aa0d5f45c2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3e19f1878d042b295d1f75a3a781419', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:15:53.391095 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483786a1-8123-4c17-bde4-0aa0d5f45c2a service cinder] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:15:53.391367 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483786a1-8123-4c17-bde4-0aa0d5f45c2a service cinder] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:15:53.391635 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483786a1-8123-4c17-bde4-0aa0d5f45c2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:15:53.401492 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483786a1-8123-4c17-bde4-0aa0d5f45c2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:15:53.402906 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483786a1-8123-4c17-bde4-0aa0d5f45c2a service cinder] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:15:53.412886 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 467/939] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:15:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:16:03.005496 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=70 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:16:03.408089 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=33 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:17:07.227984 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3dea4-68dc-4d85-b53c-d03095735977 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.228692 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3dea4-68dc-4d85-b53c-d03095735977 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.228692 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3dea4-68dc-4d85-b53c-d03095735977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.234316 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30173-69b6-4039-949d-09c5578c0dec None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.234754 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30173-69b6-4039-949d-09c5578c0dec None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.234856 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30173-69b6-4039-949d-09c5578c0dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.247681 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-0ae3dea4-68dc-4d85-b53c-d03095735977 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:07.248912 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-0ae3dea4-68dc-4d85-b53c-d03095735977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:07.254420 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-ddc30173-69b6-4039-949d-09c5578c0dec None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:07.255585 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-ddc30173-69b6-4039-949d-09c5578c0dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:07.257316 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 473/940] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:17:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:07.263326 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 468/941] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:17:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:17:07.266158 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cee13-6da6-4c51-bc65-577e26384590 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.266440 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cee13-6da6-4c51-bc65-577e26384590 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.266712 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cee13-6da6-4c51-bc65-577e26384590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.272831 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9bb59-54cc-4532-a8c7-a2ff1370ec0c None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.273168 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9bb59-54cc-4532-a8c7-a2ff1370ec0c None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.273387 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9bb59-54cc-4532-a8c7-a2ff1370ec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.286876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-a97cee13-6da6-4c51-bc65-577e26384590 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:07.288054 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-a97cee13-6da6-4c51-bc65-577e26384590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:07.292699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-d8b9bb59-54cc-4532-a8c7-a2ff1370ec0c None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:07.293860 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-d8b9bb59-54cc-4532-a8c7-a2ff1370ec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:07.295687 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 474/942] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:17:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:07.300159 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cee13-6da6-4c51-bc65-577e26384590 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.301987 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 469/943] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:17:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:17:07.306089 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9bb59-54cc-4532-a8c7-a2ff1370ec0c None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.310218 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cee13-6da6-4c51-bc65-577e26384590 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.315385 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9bb59-54cc-4532-a8c7-a2ff1370ec0c None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.315526 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc28d98-ac61-4ae5-9228-3a9cf76ca38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.316073 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc28d98-ac61-4ae5-9228-3a9cf76ca38c admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.316375 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc28d98-ac61-4ae5-9228-3a9cf76ca38c admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.316638 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc28d98-ac61-4ae5-9228-3a9cf76ca38c admin admin] PATH_INFO: `/v3/domains` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.317271 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc28d98-ac61-4ae5-9228-3a9cf76ca38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:17:07.317564 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc28d98-ac61-4ae5-9228-3a9cf76ca38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.319125 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc28d98-ac61-4ae5-9228-3a9cf76ca38c admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.320129 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89ad7d-fb21-4cae-9fbc-c2f022042e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.320752 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89ad7d-fb21-4cae-9fbc-c2f022042e34 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.321032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89ad7d-fb21-4cae-9fbc-c2f022042e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.321735 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89ad7d-fb21-4cae-9fbc-c2f022042e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.321995 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89ad7d-fb21-4cae-9fbc-c2f022042e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 19:17:07.322297 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89ad7d-fb21-4cae-9fbc-c2f022042e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.323292 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: WARNING py.warnings [None req-7a89ad7d-fb21-4cae-9fbc-c2f022042e34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:17:07.323292 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: warnings.warn(msg) Oct 20 19:17:07.323292 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: Oct 20 19:17:07.324196 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89ad7d-fb21-4cae-9fbc-c2f022042e34 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.331463 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 475/944] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 19:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 19:17:07.337098 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 470/945] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Oct 20 19:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 19:17:07.339307 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc28d98-ac61-4ae5-9228-3a9cf76ca38c admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.344937 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89ad7d-fb21-4cae-9fbc-c2f022042e34 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.349204 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc28d98-ac61-4ae5-9228-3a9cf76ca38c admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.354486 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74e832-3f3b-4852-8f93-d03cd41f2e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.355089 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74e832-3f3b-4852-8f93-d03cd41f2e77 admin admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.355362 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74e832-3f3b-4852-8f93-d03cd41f2e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.355677 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74e832-3f3b-4852-8f93-d03cd41f2e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.356446 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74e832-3f3b-4852-8f93-d03cd41f2e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.357576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: WARNING py.warnings [None req-ad74e832-3f3b-4852-8f93-d03cd41f2e77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:17:07.357576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: warnings.warn(msg) Oct 20 19:17:07.357576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: Oct 20 19:17:07.357861 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89ad7d-fb21-4cae-9fbc-c2f022042e34 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.358871 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74e832-3f3b-4852-8f93-d03cd41f2e77 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.363693 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0817e0-4bf0-402c-8e3e-3bbb57b78e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.364318 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0817e0-4bf0-402c-8e3e-3bbb57b78e55 admin admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.364601 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0817e0-4bf0-402c-8e3e-3bbb57b78e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.364872 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0817e0-4bf0-402c-8e3e-3bbb57b78e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.365497 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0817e0-4bf0-402c-8e3e-3bbb57b78e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.367699 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0817e0-4bf0-402c-8e3e-3bbb57b78e55 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.406240 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 476/946] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 19:17:07 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 19:17:07.412683 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 471/947] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 19:17:07 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 19:17:07.412901 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74e832-3f3b-4852-8f93-d03cd41f2e77 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.414001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0817e0-4bf0-402c-8e3e-3bbb57b78e55 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.475488 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0817e0-4bf0-402c-8e3e-3bbb57b78e55 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.476006 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74e832-3f3b-4852-8f93-d03cd41f2e77 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.480325 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15aa2f7-70dd-416a-a16a-9130f3b33a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.480734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48d65f-71fa-4f62-946e-60bb0d7e58d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.480868 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aa2f7-70dd-416a-a16a-9130f3b33a0b admin admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.481141 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aa2f7-70dd-416a-a16a-9130f3b33a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.481411 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15aa2f7-70dd-416a-a16a-9130f3b33a0b admin admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.481512 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48d65f-71fa-4f62-946e-60bb0d7e58d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.481692 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48d65f-71fa-4f62-946e-60bb0d7e58d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.481964 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48d65f-71fa-4f62-946e-60bb0d7e58d7 admin admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.482081 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15aa2f7-70dd-416a-a16a-9130f3b33a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.482584 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48d65f-71fa-4f62-946e-60bb0d7e58d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.483028 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: WARNING py.warnings [None req-d15aa2f7-70dd-416a-a16a-9130f3b33a0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:17:07.483028 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: warnings.warn(msg) Oct 20 19:17:07.483028 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: Oct 20 19:17:07.484244 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15aa2f7-70dd-416a-a16a-9130f3b33a0b admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.484536 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48d65f-71fa-4f62-946e-60bb0d7e58d7 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.510914 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 477/948] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:17:07 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 19:17:07.511133 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 472/949] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:17:07 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:17:07.512888 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48d65f-71fa-4f62-946e-60bb0d7e58d7 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.513030 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15aa2f7-70dd-416a-a16a-9130f3b33a0b admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.522568 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48d65f-71fa-4f62-946e-60bb0d7e58d7 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.522736 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15aa2f7-70dd-416a-a16a-9130f3b33a0b admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.527151 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e78e5-734a-4818-a2df-b51ec5f19f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.527293 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f7aaf-228b-45ca-bc9a-553b17c31955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.527731 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e78e5-734a-4818-a2df-b51ec5f19f90 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.527835 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f7aaf-228b-45ca-bc9a-553b17c31955 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.528007 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e78e5-734a-4818-a2df-b51ec5f19f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.528108 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f7aaf-228b-45ca-bc9a-553b17c31955 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.528301 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e78e5-734a-4818-a2df-b51ec5f19f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.528466 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f7aaf-228b-45ca-bc9a-553b17c31955 admin admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.528939 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e78e5-734a-4818-a2df-b51ec5f19f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.529059 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f7aaf-228b-45ca-bc9a-553b17c31955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.530517 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e78e5-734a-4818-a2df-b51ec5f19f90 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.530633 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f7aaf-228b-45ca-bc9a-553b17c31955 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.541434 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 473/951] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 19:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:17:07.544645 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 478/951] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 19:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:17:07.545399 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e78e5-734a-4818-a2df-b51ec5f19f90 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.545728 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f7aaf-228b-45ca-bc9a-553b17c31955 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.555323 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f7aaf-228b-45ca-bc9a-553b17c31955 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.555476 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e78e5-734a-4818-a2df-b51ec5f19f90 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.559820 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf47f16-a407-4a12-a6b1-fe11d2f47a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.559949 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17804a-0a3c-433b-990b-e175ef604bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.560430 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf47f16-a407-4a12-a6b1-fe11d2f47a80 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.560554 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17804a-0a3c-433b-990b-e175ef604bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.560704 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf47f16-a407-4a12-a6b1-fe11d2f47a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.560813 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17804a-0a3c-433b-990b-e175ef604bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.560968 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf47f16-a407-4a12-a6b1-fe11d2f47a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.561062 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17804a-0a3c-433b-990b-e175ef604bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.561582 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf47f16-a407-4a12-a6b1-fe11d2f47a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.561695 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17804a-0a3c-433b-990b-e175ef604bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.563134 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf47f16-a407-4a12-a6b1-fe11d2f47a80 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.563275 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17804a-0a3c-433b-990b-e175ef604bf7 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.574334 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 474/952] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 19:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 19:17:07.574477 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 479/953] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 19:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:17:07.578311 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf47f16-a407-4a12-a6b1-fe11d2f47a80 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.578451 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17804a-0a3c-433b-990b-e175ef604bf7 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.588497 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf47f16-a407-4a12-a6b1-fe11d2f47a80 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.589155 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17804a-0a3c-433b-990b-e175ef604bf7 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.592989 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777a092-a9e7-452e-9ab7-aaa3c8b616dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.593613 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a092-a9e7-452e-9ab7-aaa3c8b616dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.593742 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f078-003a-4f0b-a6f4-8fb6726a0e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.593883 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a092-a9e7-452e-9ab7-aaa3c8b616dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.594152 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a092-a9e7-452e-9ab7-aaa3c8b616dd admin admin] PATH_INFO: `/v3/projects/c51ec6c9eb634fb99f2e9c03990275fe/users/91653d9246be453db87c7757205049d2/roles/bbdc52113ece4f3da0ee37763b27b9e5` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.594451 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f078-003a-4f0b-a6f4-8fb6726a0e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.594730 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f078-003a-4f0b-a6f4-8fb6726a0e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.594998 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f078-003a-4f0b-a6f4-8fb6726a0e9a admin admin] PATH_INFO: `/v3/projects/073a564090e8442abf7ff94cab6add4f/users/d0444849cf1a42508876bd71e9fae2e6/roles/bbdc52113ece4f3da0ee37763b27b9e5` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.609874 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777a092-a9e7-452e-9ab7-aaa3c8b616dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51ec6c9eb634fb99f2e9c03990275fe, user_id=91653d9246be453db87c7757205049d2, role_id=bbdc52113ece4f3da0ee37763b27b9e5)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.610230 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f078-003a-4f0b-a6f4-8fb6726a0e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=073a564090e8442abf7ff94cab6add4f, user_id=d0444849cf1a42508876bd71e9fae2e6, role_id=bbdc52113ece4f3da0ee37763b27b9e5)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.612904 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777a092-a9e7-452e-9ab7-aaa3c8b616dd admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.613034 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f078-003a-4f0b-a6f4-8fb6726a0e9a admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.626269 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 480/954] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 19:17:07 2022] PUT /identity/v3/projects/073a564090e8442abf7ff94cab6add4f/users/d0444849cf1a42508876bd71e9fae2e6/roles/bbdc52113ece4f3da0ee37763b27b9e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:17:07.626978 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 475/955] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 19:17:07 2022] PUT /identity/v3/projects/c51ec6c9eb634fb99f2e9c03990275fe/users/91653d9246be453db87c7757205049d2/roles/bbdc52113ece4f3da0ee37763b27b9e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 19:17:07.631598 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173f48-e35a-44b1-8dd3-9d871bf58cfe None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.631762 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89123a04-6cc4-40b9-9b06-c603db037fb7 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.631882 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173f48-e35a-44b1-8dd3-9d871bf58cfe None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.632132 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89123a04-6cc4-40b9-9b06-c603db037fb7 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.632244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173f48-e35a-44b1-8dd3-9d871bf58cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.632540 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89123a04-6cc4-40b9-9b06-c603db037fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.651609 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-d0173f48-e35a-44b1-8dd3-9d871bf58cfe None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:07.651996 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-89123a04-6cc4-40b9-9b06-c603db037fb7 None None] MFA Rules not processed for user `cc589496feb245fc97089364fc0bb055`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:07.652838 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-d0173f48-e35a-44b1-8dd3-9d871bf58cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:07.653194 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-89123a04-6cc4-40b9-9b06-c603db037fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:07.694287 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:17:07.699397 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:17:07.713562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 481/956] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:17:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:07.718952 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 476/957] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:17:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:07.724873 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0173f48-e35a-44b1-8dd3-9d871bf58cfe None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.729252 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89123a04-6cc4-40b9-9b06-c603db037fb7 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:07.731273 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-89123a04-6cc4-40b9-9b06-c603db037fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:07.780338 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0173f48-e35a-44b1-8dd3-9d871bf58cfe None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.784876 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf0e93-7059-4e31-92b8-6e974e9f5793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.785481 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf0e93-7059-4e31-92b8-6e974e9f5793 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.785783 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf0e93-7059-4e31-92b8-6e974e9f5793 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.786054 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf0e93-7059-4e31-92b8-6e974e9f5793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.795137 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf0e93-7059-4e31-92b8-6e974e9f5793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.796596 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf0e93-7059-4e31-92b8-6e974e9f5793 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.799309 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89123a04-6cc4-40b9-9b06-c603db037fb7 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:07.803890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74738-beeb-44ca-9486-dd8fcd901f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:07.804655 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74738-beeb-44ca-9486-dd8fcd901f5d service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:07.804935 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74738-beeb-44ca-9486-dd8fcd901f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:07.805204 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c74738-beeb-44ca-9486-dd8fcd901f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:07.806131 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 482/958] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:17:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:17:07.814583 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c74738-beeb-44ca-9486-dd8fcd901f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:07.816009 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c74738-beeb-44ca-9486-dd8fcd901f5d service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:07.825577 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 477/959] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:17:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 19:17:13.332726 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d794e9-c83e-4443-a885-0bc61a6ab22c None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:13.334293 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d794e9-c83e-4443-a885-0bc61a6ab22c None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:13.334670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d794e9-c83e-4443-a885-0bc61a6ab22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:13.383517 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-38d794e9-c83e-4443-a885-0bc61a6ab22c None None] MFA Rules not processed for user `91653d9246be453db87c7757205049d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:13.385337 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-38d794e9-c83e-4443-a885-0bc61a6ab22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:13.515432 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 483/960] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:17:13 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:13.519674 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74738-beeb-44ca-9486-dd8fcd901f5d service neutron] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:13.530125 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c74738-beeb-44ca-9486-dd8fcd901f5d service neutron] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:13.537845 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55da3a-56da-4048-9464-9049f3d6e7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:13.538471 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55da3a-56da-4048-9464-9049f3d6e7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:13.538745 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55da3a-56da-4048-9464-9049f3d6e7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:13.539016 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55da3a-56da-4048-9464-9049f3d6e7c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:13.539698 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55da3a-56da-4048-9464-9049f3d6e7c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:13.546297 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55da3a-56da-4048-9464-9049f3d6e7c2 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:13.606109 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 478/961] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 19:17:13 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:17:13.610042 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d794e9-c83e-4443-a885-0bc61a6ab22c None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:13.628254 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d794e9-c83e-4443-a885-0bc61a6ab22c None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:13.739659 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d82d7-d2bf-48b6-82e7-89a9d6d35f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:13.740208 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d82d7-d2bf-48b6-82e7-89a9d6d35f73 admin admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:13.740599 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d82d7-d2bf-48b6-82e7-89a9d6d35f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:13.740880 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d82d7-d2bf-48b6-82e7-89a9d6d35f73 admin admin] PATH_INFO: `/v3/users` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:13.741523 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d82d7-d2bf-48b6-82e7-89a9d6d35f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:13.744107 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d82d7-d2bf-48b6-82e7-89a9d6d35f73 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:13.774855 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 484/962] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:17:13 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:17:13.778395 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55da3a-56da-4048-9464-9049f3d6e7c2 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:13.790395 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55da3a-56da-4048-9464-9049f3d6e7c2 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:13.796026 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc35fb2-7c25-409f-bdb6-f17c024074ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:13.796764 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35fb2-7c25-409f-bdb6-f17c024074ad admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:13.796937 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35fb2-7c25-409f-bdb6-f17c024074ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:13.797205 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc35fb2-7c25-409f-bdb6-f17c024074ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:13.797874 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc35fb2-7c25-409f-bdb6-f17c024074ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:13.800054 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc35fb2-7c25-409f-bdb6-f17c024074ad admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:13.811003 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 479/963] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 19:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:17:13.815639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d82d7-d2bf-48b6-82e7-89a9d6d35f73 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:13.829863 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d82d7-d2bf-48b6-82e7-89a9d6d35f73 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:13.835701 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab782f-a004-45bf-8e12-46ae7d468887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:13.836494 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab782f-a004-45bf-8e12-46ae7d468887 admin admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:13.836855 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab782f-a004-45bf-8e12-46ae7d468887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:13.837341 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab782f-a004-45bf-8e12-46ae7d468887 admin admin] PATH_INFO: `/v3/projects/bcd0c74aef524657b7d8570942d87d99/users/f75dfc3207ab4185987e2eddebd1e0a8/roles/fde247f30afe4b81958b67c776cabec0` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:13.850376 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:17:13.867762 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab782f-a004-45bf-8e12-46ae7d468887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd0c74aef524657b7d8570942d87d99, user_id=f75dfc3207ab4185987e2eddebd1e0a8, role_id=fde247f30afe4b81958b67c776cabec0)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:13.870827 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab782f-a004-45bf-8e12-46ae7d468887 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:13.891364 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 485/964] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 19:17:13 2022] PUT /identity/v3/projects/bcd0c74aef524657b7d8570942d87d99/users/f75dfc3207ab4185987e2eddebd1e0a8/roles/fde247f30afe4b81958b67c776cabec0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 19:17:13.896964 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc35fb2-7c25-409f-bdb6-f17c024074ad admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:13.913154 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc35fb2-7c25-409f-bdb6-f17c024074ad admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:14.020006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5a40e-2b81-4a4b-9fa4-9858040a27d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:14.020651 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a40e-2b81-4a4b-9fa4-9858040a27d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:14.020926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a40e-2b81-4a4b-9fa4-9858040a27d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:14.021196 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a40e-2b81-4a4b-9fa4-9858040a27d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:14.021902 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5a40e-2b81-4a4b-9fa4-9858040a27d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:14.023516 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5a40e-2b81-4a4b-9fa4-9858040a27d4 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:14.040657 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 480/965] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 19:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 19:17:14.042446 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab782f-a004-45bf-8e12-46ae7d468887 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:14.053832 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab782f-a004-45bf-8e12-46ae7d468887 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:14.061058 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e241a-13da-4a11-b82f-7382410d5678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:14.061742 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e241a-13da-4a11-b82f-7382410d5678 admin admin] REQUEST_METHOD: `PUT` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:14.062004 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e241a-13da-4a11-b82f-7382410d5678 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:14.062283 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e241a-13da-4a11-b82f-7382410d5678 admin admin] PATH_INFO: `/v3/projects/bcd0c74aef524657b7d8570942d87d99/users/f75dfc3207ab4185987e2eddebd1e0a8/roles/fde247f30afe4b81958b67c776cabec0` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:14.065064 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e241a-13da-4a11-b82f-7382410d5678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd0c74aef524657b7d8570942d87d99, user_id=f75dfc3207ab4185987e2eddebd1e0a8, role_id=fde247f30afe4b81958b67c776cabec0)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:14.068179 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e241a-13da-4a11-b82f-7382410d5678 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:14.090620 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 486/966] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 19:17:14 2022] PUT /identity/v3/projects/bcd0c74aef524657b7d8570942d87d99/users/f75dfc3207ab4185987e2eddebd1e0a8/roles/fde247f30afe4b81958b67c776cabec0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 19:17:14.154576 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab44e-398d-4c1c-bb19-83f88306ba4c None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:14.154997 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab44e-398d-4c1c-bb19-83f88306ba4c None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:14.155366 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab44e-398d-4c1c-bb19-83f88306ba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:14.190778 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-410ab44e-398d-4c1c-bb19-83f88306ba4c None None] MFA Rules not processed for user `d0444849cf1a42508876bd71e9fae2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:14.192498 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-410ab44e-398d-4c1c-bb19-83f88306ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:14.229155 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:17:14.290280 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 481/967] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:17:14 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:14.294754 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e241a-13da-4a11-b82f-7382410d5678 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:14.406516 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e241a-13da-4a11-b82f-7382410d5678 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:14.416293 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b004f0-c169-4963-8d3f-d0993ecbc73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:14.416925 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b004f0-c169-4963-8d3f-d0993ecbc73b admin admin] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:14.417202 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b004f0-c169-4963-8d3f-d0993ecbc73b admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:14.417472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b004f0-c169-4963-8d3f-d0993ecbc73b admin admin] PATH_INFO: `/v3/projects` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:14.418153 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b004f0-c169-4963-8d3f-d0993ecbc73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:14.420056 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b004f0-c169-4963-8d3f-d0993ecbc73b admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:14.468827 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 487/968] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Oct 20 19:17:14 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:17:14.473660 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab44e-398d-4c1c-bb19-83f88306ba4c None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:14.488950 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab44e-398d-4c1c-bb19-83f88306ba4c None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:14.573810 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79c6f7-d24a-4352-a5ec-ae8548f6aca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:14.574451 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c6f7-d24a-4352-a5ec-ae8548f6aca7 admin admin] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:14.574689 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c6f7-d24a-4352-a5ec-ae8548f6aca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:14.574952 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79c6f7-d24a-4352-a5ec-ae8548f6aca7 admin admin] PATH_INFO: `/v3/users` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:14.576257 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79c6f7-d24a-4352-a5ec-ae8548f6aca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:14.578298 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79c6f7-d24a-4352-a5ec-ae8548f6aca7 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:14.612411 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 482/969] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Oct 20 19:17:14 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 19:17:14.616139 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b004f0-c169-4963-8d3f-d0993ecbc73b admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:14.631805 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b004f0-c169-4963-8d3f-d0993ecbc73b admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:14.638835 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3581078-679f-4b2a-8c42-df24f94cfdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:14.640832 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3581078-679f-4b2a-8c42-df24f94cfdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:14.641483 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3581078-679f-4b2a-8c42-df24f94cfdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:14.642866 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3581078-679f-4b2a-8c42-df24f94cfdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:14.644261 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3581078-679f-4b2a-8c42-df24f94cfdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:14.646877 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3581078-679f-4b2a-8c42-df24f94cfdd5 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:14.669275 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 488/970] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 19:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 19:17:14.674439 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79c6f7-d24a-4352-a5ec-ae8548f6aca7 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:14.686060 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79c6f7-d24a-4352-a5ec-ae8548f6aca7 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:14.702625 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea187d-461f-4635-ab8b-4fe52e39b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:14.705060 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea187d-461f-4635-ab8b-4fe52e39b4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:14.705518 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea187d-461f-4635-ab8b-4fe52e39b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:14.705864 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea187d-461f-4635-ab8b-4fe52e39b4a3 admin admin] PATH_INFO: `/v3/projects/b7ebe29be418471da8b0c2c38256301f/users/7966bf37de9a407ba19b8e1a1cafaf87/roles/fde247f30afe4b81958b67c776cabec0` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:14.726143 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea187d-461f-4635-ab8b-4fe52e39b4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ebe29be418471da8b0c2c38256301f, user_id=7966bf37de9a407ba19b8e1a1cafaf87, role_id=fde247f30afe4b81958b67c776cabec0)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:14.730101 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea187d-461f-4635-ab8b-4fe52e39b4a3 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:14.755747 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 483/971] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 19:17:14 2022] PUT /identity/v3/projects/b7ebe29be418471da8b0c2c38256301f/users/7966bf37de9a407ba19b8e1a1cafaf87/roles/fde247f30afe4b81958b67c776cabec0 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:17:14.756617 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3581078-679f-4b2a-8c42-df24f94cfdd5 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:14.767662 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3581078-679f-4b2a-8c42-df24f94cfdd5 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:14.875670 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8c29c-0669-4f9e-b898-e21a4b16a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:14.876854 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8c29c-0669-4f9e-b898-e21a4b16a785 admin admin] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:14.877131 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8c29c-0669-4f9e-b898-e21a4b16a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:14.877399 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8c29c-0669-4f9e-b898-e21a4b16a785 admin admin] PATH_INFO: `/v3/roles` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:14.883822 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8c29c-0669-4f9e-b898-e21a4b16a785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:14.885930 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8c29c-0669-4f9e-b898-e21a4b16a785 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:14.913696 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 489/972] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Oct 20 19:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 19:17:14.915371 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea187d-461f-4635-ab8b-4fe52e39b4a3 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:14.932245 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea187d-461f-4635-ab8b-4fe52e39b4a3 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:14.944436 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264a89e-0334-40b4-9a8a-e76b7ad07ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:14.945184 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264a89e-0334-40b4-9a8a-e76b7ad07ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:14.945736 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264a89e-0334-40b4-9a8a-e76b7ad07ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:14.946025 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264a89e-0334-40b4-9a8a-e76b7ad07ef6 admin admin] PATH_INFO: `/v3/projects/b7ebe29be418471da8b0c2c38256301f/users/7966bf37de9a407ba19b8e1a1cafaf87/roles/fde247f30afe4b81958b67c776cabec0` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:14.947996 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264a89e-0334-40b4-9a8a-e76b7ad07ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ebe29be418471da8b0c2c38256301f, user_id=7966bf37de9a407ba19b8e1a1cafaf87, role_id=fde247f30afe4b81958b67c776cabec0)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:14.951752 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264a89e-0334-40b4-9a8a-e76b7ad07ef6 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:14.971731 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 484/973] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Oct 20 19:17:14 2022] PUT /identity/v3/projects/b7ebe29be418471da8b0c2c38256301f/users/7966bf37de9a407ba19b8e1a1cafaf87/roles/fde247f30afe4b81958b67c776cabec0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:17:20.239416 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49f1ad-822a-4e92-bd18-01b1386035db None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:20.240521 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49f1ad-822a-4e92-bd18-01b1386035db None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:20.240995 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49f1ad-822a-4e92-bd18-01b1386035db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:20.275342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-bc49f1ad-822a-4e92-bd18-01b1386035db None None] MFA Rules not processed for user `f75dfc3207ab4185987e2eddebd1e0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:20.276759 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-bc49f1ad-822a-4e92-bd18-01b1386035db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:20.355441 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:17:20.492167 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 490/974] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:17:20 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:20.508439 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264a89e-0334-40b4-9a8a-e76b7ad07ef6 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:20.510920 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-a264a89e-0334-40b4-9a8a-e76b7ad07ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:20.708201 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264a89e-0334-40b4-9a8a-e76b7ad07ef6 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:20.722813 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbe547-2eae-4808-9b43-3951b73fa351 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b28a7b6a48d48f5a23741ad142c93ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:20.723551 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbe547-2eae-4808-9b43-3951b73fa351 service glance] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:20.725511 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbe547-2eae-4808-9b43-3951b73fa351 service glance] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:20.725905 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbe547-2eae-4808-9b43-3951b73fa351 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:20.777192 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:17:20.831137 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbe547-2eae-4808-9b43-3951b73fa351 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:20.832857 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbe547-2eae-4808-9b43-3951b73fa351 service glance] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:20.850536 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 485/975] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:17:20 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:17:21.136084 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c257c8-5b56-4b06-9cf2-7887fda275f2 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:21.136438 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c257c8-5b56-4b06-9cf2-7887fda275f2 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:21.136711 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c257c8-5b56-4b06-9cf2-7887fda275f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:21.199648 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-44c257c8-5b56-4b06-9cf2-7887fda275f2 None None] MFA Rules not processed for user `7966bf37de9a407ba19b8e1a1cafaf87`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:21.200970 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-44c257c8-5b56-4b06-9cf2-7887fda275f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:21.346316 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 491/976] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:17:21 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:21.359803 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbe547-2eae-4808-9b43-3951b73fa351 service glance] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:21.362418 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-71fbe547-2eae-4808-9b43-3951b73fa351 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:21.381254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbe547-2eae-4808-9b43-3951b73fa351 service glance] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:21.397022 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aca00a-e096-4e06-9b1e-c714899898f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b28a7b6a48d48f5a23741ad142c93ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:21.397648 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca00a-e096-4e06-9b1e-c714899898f1 service glance] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:21.397922 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca00a-e096-4e06-9b1e-c714899898f1 service glance] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:21.398203 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aca00a-e096-4e06-9b1e-c714899898f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:21.518909 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aca00a-e096-4e06-9b1e-c714899898f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:21.523144 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aca00a-e096-4e06-9b1e-c714899898f1 service glance] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:21.535078 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 486/977] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:17:21 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:17:29.909717 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a2738-69a0-4abe-ac93-3b05a6ea63a8 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:29.910304 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a2738-69a0-4abe-ac93-3b05a6ea63a8 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:29.910304 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a2738-69a0-4abe-ac93-3b05a6ea63a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:29.931125 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-588a2738-69a0-4abe-ac93-3b05a6ea63a8 None None] MFA Rules not processed for user `d0444849cf1a42508876bd71e9fae2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:29.932350 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-588a2738-69a0-4abe-ac93-3b05a6ea63a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:29.939707 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 492/978] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:17:29 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:30.232030 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cac48d-ffea-4a3e-bf6c-1f26925df9e6 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:30.232579 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cac48d-ffea-4a3e-bf6c-1f26925df9e6 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:30.232579 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cac48d-ffea-4a3e-bf6c-1f26925df9e6 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:30.233989 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 487/979] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 19:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:17:30.242176 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff024-dd96-41c8-9caa-b739604ac9ae None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:30.242724 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff024-dd96-41c8-9caa-b739604ac9ae None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:30.243099 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff024-dd96-41c8-9caa-b739604ac9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:30.276166 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-f1cff024-dd96-41c8-9caa-b739604ac9ae None None] MFA Rules not processed for user `cc6df159e6dc419cae222ebc3e5c99f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:30.277488 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-f1cff024-dd96-41c8-9caa-b739604ac9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:30.342488 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 493/980] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 19:17:30 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:30.348748 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5021ff6-9b03-4011-8c37-b0eee0f21b40 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:30.349032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5021ff6-9b03-4011-8c37-b0eee0f21b40 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:30.349327 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5021ff6-9b03-4011-8c37-b0eee0f21b40 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:30.350644 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 488/981] 10.222.0.16 () {54 vars in 912 bytes} [Thu Oct 20 19:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:17:30.355578 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea4b27-b6d3-4897-b330-aff058334d33 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:30.355859 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea4b27-b6d3-4897-b330-aff058334d33 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:30.356129 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea4b27-b6d3-4897-b330-aff058334d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:30.375261 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-59ea4b27-b6d3-4897-b330-aff058334d33 None None] MFA Rules not processed for user `cc6df159e6dc419cae222ebc3e5c99f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:30.376773 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-59ea4b27-b6d3-4897-b330-aff058334d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:30.385500 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 494/982] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 19:17:30 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:30.398087 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5021ff6-9b03-4011-8c37-b0eee0f21b40 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:30.410271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5021ff6-9b03-4011-8c37-b0eee0f21b40 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:30.414119 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8157e-e760-4ae9-bb3e-217391b932f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b28a7b6a48d48f5a23741ad142c93ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:30.414703 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8157e-e760-4ae9-bb3e-217391b932f1 service glance] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:30.414981 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8157e-e760-4ae9-bb3e-217391b932f1 service glance] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:30.415347 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8157e-e760-4ae9-bb3e-217391b932f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:30.424645 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8157e-e760-4ae9-bb3e-217391b932f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:30.426101 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8157e-e760-4ae9-bb3e-217391b932f1 service glance] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:30.436225 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 489/983] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:17:30 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 19:17:30.885584 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7644319-4506-42c9-8e6d-c8688b6c49df None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:30.885862 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7644319-4506-42c9-8e6d-c8688b6c49df None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:30.886155 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7644319-4506-42c9-8e6d-c8688b6c49df None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:30.887475 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 495/984] 10.222.0.16 () {54 vars in 912 bytes} [Thu Oct 20 19:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:17:30.893033 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89ae9a-6e56-4c53-9d07-f13bd227ff8b None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:30.893385 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89ae9a-6e56-4c53-9d07-f13bd227ff8b None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:30.893721 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89ae9a-6e56-4c53-9d07-f13bd227ff8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:30.913890 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-5e89ae9a-6e56-4c53-9d07-f13bd227ff8b None None] MFA Rules not processed for user `09fce752a3264bb19af1260da2b83315`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:30.915064 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-5e89ae9a-6e56-4c53-9d07-f13bd227ff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:30.970332 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 490/985] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 19:17:30 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:17:30.981759 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7644319-4506-42c9-8e6d-c8688b6c49df None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:30.992749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7644319-4506-42c9-8e6d-c8688b6c49df None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:30.996391 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fbcdf-8c82-49d3-8ca8-8b18cbd69995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:30.996975 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fbcdf-8c82-49d3-8ca8-8b18cbd69995 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:30.997249 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fbcdf-8c82-49d3-8ca8-8b18cbd69995 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:30.997510 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fbcdf-8c82-49d3-8ca8-8b18cbd69995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:31.004682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fbcdf-8c82-49d3-8ca8-8b18cbd69995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:31.006166 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fbcdf-8c82-49d3-8ca8-8b18cbd69995 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:31.014173 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 496/986] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:17:30 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:17:31.428803 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f8ae3-86e5-46bd-bf1f-6acb21162ae6 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:31.429363 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f8ae3-86e5-46bd-bf1f-6acb21162ae6 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:31.429553 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f8ae3-86e5-46bd-bf1f-6acb21162ae6 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:31.430893 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 491/987] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 19:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:17:31.442116 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500d14b-19f3-47a5-ba3b-cd109bc9faba None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:31.443397 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500d14b-19f3-47a5-ba3b-cd109bc9faba None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:31.443749 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500d14b-19f3-47a5-ba3b-cd109bc9faba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:31.453972 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f8ae3-86e5-46bd-bf1f-6acb21162ae6 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:31.466236 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-6500d14b-19f3-47a5-ba3b-cd109bc9faba None None] MFA Rules not processed for user `cc6df159e6dc419cae222ebc3e5c99f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:31.468191 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-6500d14b-19f3-47a5-ba3b-cd109bc9faba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:31.477800 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 497/988] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 19:17:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:31.483452 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa185905-3f40-4236-97c6-850ff3480650 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:31.483736 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa185905-3f40-4236-97c6-850ff3480650 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:31.484010 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa185905-3f40-4236-97c6-850ff3480650 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:31.486246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 498/989] 10.222.0.16 () {54 vars in 912 bytes} [Thu Oct 20 19:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:17:31.493278 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1ce2-95e4-499d-a37d-877ecfd631d8 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:31.493649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1ce2-95e4-499d-a37d-877ecfd631d8 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:31.493993 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1ce2-95e4-499d-a37d-877ecfd631d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:31.505607 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=100 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:17:31.518255 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-3ced1ce2-95e4-499d-a37d-877ecfd631d8 None None] MFA Rules not processed for user `cc6df159e6dc419cae222ebc3e5c99f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:31.519472 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-3ced1ce2-95e4-499d-a37d-877ecfd631d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:31.525262 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:17:31.529181 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 499/990] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 19:17:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:31.530978 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f8ae3-86e5-46bd-bf1f-6acb21162ae6 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:31.541587 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1ce2-95e4-499d-a37d-877ecfd631d8 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:31.543385 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b56874-4e2b-43c8-9665-02b9358b77f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43fc68da6f184762a5e7312ce37f4988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:31.543992 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b56874-4e2b-43c8-9665-02b9358b77f8 service placement] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:31.544293 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b56874-4e2b-43c8-9665-02b9358b77f8 service placement] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:31.544557 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b56874-4e2b-43c8-9665-02b9358b77f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:31.546460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-c0b56874-4e2b-43c8-9665-02b9358b77f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:31.552591 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1ce2-95e4-499d-a37d-877ecfd631d8 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:31.556406 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c57a-e510-466d-b0eb-406d68acd508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:31.557002 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c57a-e510-466d-b0eb-406d68acd508 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:31.557277 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c57a-e510-466d-b0eb-406d68acd508 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:31.557540 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c57a-e510-466d-b0eb-406d68acd508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:31.559006 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b56874-4e2b-43c8-9665-02b9358b77f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:31.561179 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b56874-4e2b-43c8-9665-02b9358b77f8 service placement] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:31.568004 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535c57a-e510-466d-b0eb-406d68acd508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:31.569437 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535c57a-e510-466d-b0eb-406d68acd508 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:31.572730 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 492/991] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:17:31 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 19:17:31.580041 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 500/992] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:17:31 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 19:17:41.568142 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=4 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:17:41.580921 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=7 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:17:43.308396 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd75a4-c23c-492c-8929-a84e69053e90 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:43.308979 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd75a4-c23c-492c-8929-a84e69053e90 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:43.308979 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd75a4-c23c-492c-8929-a84e69053e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:43.329083 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-f4cd75a4-c23c-492c-8929-a84e69053e90 None None] MFA Rules not processed for user `09fce752a3264bb19af1260da2b83315`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:43.330277 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-f4cd75a4-c23c-492c-8929-a84e69053e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:43.336593 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 493/993] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Oct 20 19:17:43 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:43.349731 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c57a-e510-466d-b0eb-406d68acd508 service neutron] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:43.358263 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c57a-e510-466d-b0eb-406d68acd508 service neutron] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:43.362217 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980eda08-7cb0-4eb7-b9ec-52f846f33d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:43.362811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eda08-7cb0-4eb7-b9ec-52f846f33d58 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:43.363087 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eda08-7cb0-4eb7-b9ec-52f846f33d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:43.363354 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eda08-7cb0-4eb7-b9ec-52f846f33d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:43.370716 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980eda08-7cb0-4eb7-b9ec-52f846f33d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:43.372155 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980eda08-7cb0-4eb7-b9ec-52f846f33d58 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:43.380416 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 501/994] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:17:43 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:17:44.267979 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2c58-1948-4a1e-9580-3d91f9955a28 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:44.268203 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2c58-1948-4a1e-9580-3d91f9955a28 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:44.268480 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2c58-1948-4a1e-9580-3d91f9955a28 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:44.269901 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 494/995] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 19:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:17:44.305062 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23583ea5-d072-41f9-a323-15075c8233f7 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:44.305359 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23583ea5-d072-41f9-a323-15075c8233f7 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:44.305615 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23583ea5-d072-41f9-a323-15075c8233f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:44.327001 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-23583ea5-d072-41f9-a323-15075c8233f7 None None] MFA Rules not processed for user `cc6df159e6dc419cae222ebc3e5c99f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:44.328784 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-23583ea5-d072-41f9-a323-15075c8233f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:44.339074 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 502/996] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 19:17:44 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:17:44.368750 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e2c58-1948-4a1e-9580-3d91f9955a28 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:44.395024 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e2c58-1948-4a1e-9580-3d91f9955a28 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:44.400649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd70e2-098c-485d-848c-d53807950437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:44.401300 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd70e2-098c-485d-848c-d53807950437 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:44.401589 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd70e2-098c-485d-848c-d53807950437 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:44.401860 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd70e2-098c-485d-848c-d53807950437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:44.413683 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd70e2-098c-485d-848c-d53807950437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:44.415242 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd70e2-098c-485d-848c-d53807950437 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:44.431291 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 495/997] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:17:44 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:17:52.061468 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362f2fe-09f3-488f-88e3-73f714d4643a None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:52.062828 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362f2fe-09f3-488f-88e3-73f714d4643a None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:52.062828 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362f2fe-09f3-488f-88e3-73f714d4643a None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:52.064246 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 503/998] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 19:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:17:52.071440 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c777-86a6-48e7-b311-366f49d59d2e None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:52.072321 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c777-86a6-48e7-b311-366f49d59d2e None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:52.072797 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c777-86a6-48e7-b311-366f49d59d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:52.108513 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-3ce4c777-86a6-48e7-b311-366f49d59d2e None None] MFA Rules not processed for user `cc6df159e6dc419cae222ebc3e5c99f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:17:52.110456 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-3ce4c777-86a6-48e7-b311-366f49d59d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:17:52.119876 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 496/999] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 19:17:52 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:17:52.140253 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362f2fe-09f3-488f-88e3-73f714d4643a None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:17:52.159469 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362f2fe-09f3-488f-88e3-73f714d4643a None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:17:52.164923 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7c6c5-dba0-459e-b6b2-932c720bc1be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:17:52.165576 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c6c5-dba0-459e-b6b2-932c720bc1be service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:17:52.165910 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c6c5-dba0-459e-b6b2-932c720bc1be service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:17:52.166244 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7c6c5-dba0-459e-b6b2-932c720bc1be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:17:52.176252 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7c6c5-dba0-459e-b6b2-932c720bc1be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:17:52.178569 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7c6c5-dba0-459e-b6b2-932c720bc1be service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:17:52.190534 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 504/1000] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:17:52 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:18:02.092775 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=12 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:18:02.185113 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=15 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:18:05.471520 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c777-86a6-48e7-b311-366f49d59d2e None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:18:05.480583 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c777-86a6-48e7-b311-366f49d59d2e None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:18:05.484104 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b009a8d-3476-4ef3-838a-779b7aca2373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:18:05.484728 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b009a8d-3476-4ef3-838a-779b7aca2373 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:18:05.485001 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b009a8d-3476-4ef3-838a-779b7aca2373 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:18:05.485269 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b009a8d-3476-4ef3-838a-779b7aca2373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:18:05.494423 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b009a8d-3476-4ef3-838a-779b7aca2373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:18:05.495887 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b009a8d-3476-4ef3-838a-779b7aca2373 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:18:05.506634 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 497/1001] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:18:05 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:18:15.502254 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=6 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:18:18.650524 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a994-e1db-4acd-b4a1-612b24c9f895 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:18:18.651058 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a994-e1db-4acd-b4a1-612b24c9f895 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:18:18.651058 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a994-e1db-4acd-b4a1-612b24c9f895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:18:18.671218 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-ecc9a994-e1db-4acd-b4a1-612b24c9f895 None None] MFA Rules not processed for user `91653d9246be453db87c7757205049d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:18:18.672437 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-ecc9a994-e1db-4acd-b4a1-612b24c9f895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:18:18.679096 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 505/1002] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:18:18 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:18:28.665692 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=3 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:18:44.135032 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2452c-faa6-40b2-a7b4-bcd4780774d3 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:18:44.135533 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2452c-faa6-40b2-a7b4-bcd4780774d3 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:18:44.135630 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2452c-faa6-40b2-a7b4-bcd4780774d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:18:44.154381 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-4dc2452c-faa6-40b2-a7b4-bcd4780774d3 None None] MFA Rules not processed for user `91653d9246be453db87c7757205049d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:18:44.155827 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-4dc2452c-faa6-40b2-a7b4-bcd4780774d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:18:44.162773 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 498/1003] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:18:44 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:18:44.457000 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13af93-d5f8-4bd3-8192-c16dc54aa770 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:18:44.457504 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13af93-d5f8-4bd3-8192-c16dc54aa770 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:18:44.457610 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13af93-d5f8-4bd3-8192-c16dc54aa770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:18:44.476449 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-ab13af93-d5f8-4bd3-8192-c16dc54aa770 None None] MFA Rules not processed for user `09fce752a3264bb19af1260da2b83315`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:18:44.477615 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-ab13af93-d5f8-4bd3-8192-c16dc54aa770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:18:44.484463 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 506/1004] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Oct 20 19:18:44 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:18:44.495482 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2452c-faa6-40b2-a7b4-bcd4780774d3 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:18:44.505171 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2452c-faa6-40b2-a7b4-bcd4780774d3 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:18:44.508652 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0172760-71af-4a89-ad1b-3f1a25628544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:18:44.509233 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0172760-71af-4a89-ad1b-3f1a25628544 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:18:44.509502 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0172760-71af-4a89-ad1b-3f1a25628544 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:18:44.509764 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0172760-71af-4a89-ad1b-3f1a25628544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:18:44.516781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0172760-71af-4a89-ad1b-3f1a25628544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:18:44.518183 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0172760-71af-4a89-ad1b-3f1a25628544 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:18:44.525566 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 499/1005] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:18:44 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:18:54.471735 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=3 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:18:54.522331 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=9 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:18:59.041343 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f76a3-0bbd-4110-9e7d-cd05a5cf2108 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:18:59.041814 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f76a3-0bbd-4110-9e7d-cd05a5cf2108 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:18:59.041930 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f76a3-0bbd-4110-9e7d-cd05a5cf2108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:18:59.060616 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-633f76a3-0bbd-4110-9e7d-cd05a5cf2108 None None] MFA Rules not processed for user `91653d9246be453db87c7757205049d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:18:59.061788 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-633f76a3-0bbd-4110-9e7d-cd05a5cf2108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:18:59.068476 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 507/1006] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:18:59 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:19:09.055331 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=3 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:19:57.698055 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14512-be28-4c1c-a332-3fa0aaefcacd None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:19:57.698515 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14512-be28-4c1c-a332-3fa0aaefcacd None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:19:57.698688 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b14512-be28-4c1c-a332-3fa0aaefcacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:19:57.720691 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-36b14512-be28-4c1c-a332-3fa0aaefcacd None None] MFA Rules not processed for user `91653d9246be453db87c7757205049d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:19:57.722299 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-36b14512-be28-4c1c-a332-3fa0aaefcacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:19:57.730615 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 500/1007] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:19:57 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:20:07.714840 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=3 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:20:11.972793 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f76a3-0bbd-4110-9e7d-cd05a5cf2108 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:20:11.991184 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f76a3-0bbd-4110-9e7d-cd05a5cf2108 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:20:11.994696 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305edca-87b6-4f4d-bf75-ca6696a0eb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:20:11.995285 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305edca-87b6-4f4d-bf75-ca6696a0eb50 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:20:11.995558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305edca-87b6-4f4d-bf75-ca6696a0eb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:20:11.995824 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305edca-87b6-4f4d-bf75-ca6696a0eb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:20:12.005028 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305edca-87b6-4f4d-bf75-ca6696a0eb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:20:12.006435 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305edca-87b6-4f4d-bf75-ca6696a0eb50 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:20:12.016252 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 508/1008] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:20:11 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:20:13.938801 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa3a96-3e81-435e-b568-1bff84f1a123 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:20:13.939355 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa3a96-3e81-435e-b568-1bff84f1a123 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:20:13.939355 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa3a96-3e81-435e-b568-1bff84f1a123 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:20:13.940934 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 501/1009] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 19:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:20:13.945621 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4051b-04e1-4308-bacb-f576169e65c7 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:20:13.946065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4051b-04e1-4308-bacb-f576169e65c7 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:20:13.946292 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4051b-04e1-4308-bacb-f576169e65c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:20:13.976507 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-c7e4051b-04e1-4308-bacb-f576169e65c7 None None] MFA Rules not processed for user `cc6df159e6dc419cae222ebc3e5c99f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:20:13.977714 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-c7e4051b-04e1-4308-bacb-f576169e65c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:20:13.986979 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 509/1010] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 19:20:13 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:20:14.001278 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa3a96-3e81-435e-b568-1bff84f1a123 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:20:14.016926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa3a96-3e81-435e-b568-1bff84f1a123 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:20:14.022038 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb69ea-be15-44ba-bab5-32c87aaf6e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:20:14.022649 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb69ea-be15-44ba-bab5-32c87aaf6e66 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:20:14.022924 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb69ea-be15-44ba-bab5-32c87aaf6e66 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:20:14.023190 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb69ea-be15-44ba-bab5-32c87aaf6e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:20:14.033283 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb69ea-be15-44ba-bab5-32c87aaf6e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:20:14.034886 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb69ea-be15-44ba-bab5-32c87aaf6e66 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:20:14.046196 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 502/1011] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:20:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 19:20:23.971649 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=17 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:20:24.040940 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=6 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:21:35.133521 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4051b-04e1-4308-bacb-f576169e65c7 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:21:35.154123 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4051b-04e1-4308-bacb-f576169e65c7 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:21:35.159384 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e59494-d632-4905-bc1c-b6fc86c01d01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43fc68da6f184762a5e7312ce37f4988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:21:35.159981 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59494-d632-4905-bc1c-b6fc86c01d01 service placement] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:21:35.160258 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59494-d632-4905-bc1c-b6fc86c01d01 service placement] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:21:35.160552 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e59494-d632-4905-bc1c-b6fc86c01d01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:21:35.169490 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e59494-d632-4905-bc1c-b6fc86c01d01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:21:35.171042 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e59494-d632-4905-bc1c-b6fc86c01d01 service placement] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:21:35.180811 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 510/1012] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:21:35 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:21:45.176682 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=10 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:22:20.340464 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb69ea-be15-44ba-bab5-32c87aaf6e66 service nova] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:22:20.360232 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb69ea-be15-44ba-bab5-32c87aaf6e66 service nova] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:22:20.365230 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9e75-16c4-4965-88c2-dc8581ec1046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:22:20.365813 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9e75-16c4-4965-88c2-dc8581ec1046 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:22:20.366090 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9e75-16c4-4965-88c2-dc8581ec1046 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:22:20.366355 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db9e75-16c4-4965-88c2-dc8581ec1046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:22:20.374552 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db9e75-16c4-4965-88c2-dc8581ec1046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:22:20.376115 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db9e75-16c4-4965-88c2-dc8581ec1046 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:22:20.384650 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 503/1013] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:22:20 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:22:22.760970 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb11e46-80c3-446f-8d60-9f0c3cf0d809 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:22:22.761499 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb11e46-80c3-446f-8d60-9f0c3cf0d809 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:22:22.761622 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb11e46-80c3-446f-8d60-9f0c3cf0d809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:22:22.783582 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-5fb11e46-80c3-446f-8d60-9f0c3cf0d809 None None] MFA Rules not processed for user `91653d9246be453db87c7757205049d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:22:22.784833 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-5fb11e46-80c3-446f-8d60-9f0c3cf0d809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:22:22.791706 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 511/1014] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:22:22 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:22:29.564877 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9e75-16c4-4965-88c2-dc8581ec1046 service nova] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:22:29.573669 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db9e75-16c4-4965-88c2-dc8581ec1046 service nova] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:22:29.577740 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff230f6f-ca01-418f-856c-3b4addaf65a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:22:29.578260 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230f6f-ca01-418f-856c-3b4addaf65a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:22:29.578534 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230f6f-ca01-418f-856c-3b4addaf65a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:22:29.578801 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff230f6f-ca01-418f-856c-3b4addaf65a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:22:29.587796 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff230f6f-ca01-418f-856c-3b4addaf65a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:22:29.589243 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff230f6f-ca01-418f-856c-3b4addaf65a4 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:22:29.599883 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 504/1015] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:22:29 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:22:30.778973 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb11e46-80c3-446f-8d60-9f0c3cf0d809 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:22:30.788382 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb11e46-80c3-446f-8d60-9f0c3cf0d809 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:22:30.791926 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c992f-7903-49f7-b032-5da91599d0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:22:30.792545 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c992f-7903-49f7-b032-5da91599d0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:22:30.792859 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c992f-7903-49f7-b032-5da91599d0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:22:30.793080 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c992f-7903-49f7-b032-5da91599d0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:22:30.802827 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c992f-7903-49f7-b032-5da91599d0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:22:30.804230 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c992f-7903-49f7-b032-5da91599d0d4 service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:22:30.814697 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 512/1016] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:22:30 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:22:37.345505 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff230f6f-ca01-418f-856c-3b4addaf65a4 service neutron] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:22:37.355976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff230f6f-ca01-418f-856c-3b4addaf65a4 service neutron] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:22:37.361120 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72c689-d70f-40ef-b137-777733641bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:22:37.361721 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72c689-d70f-40ef-b137-777733641bad service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:22:37.361999 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72c689-d70f-40ef-b137-777733641bad service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:22:37.362274 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72c689-d70f-40ef-b137-777733641bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:22:37.370477 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72c689-d70f-40ef-b137-777733641bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:22:37.372062 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72c689-d70f-40ef-b137-777733641bad service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:22:37.382750 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 505/1017] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:22:37 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:22:40.810818 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=9 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:22:45.144072 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c992f-7903-49f7-b032-5da91599d0d4 service neutron] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:22:45.156181 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c992f-7903-49f7-b032-5da91599d0d4 service neutron] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:22:45.161579 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89cbb-7226-49ab-86a9-2a547a43f815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:22:45.162177 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89cbb-7226-49ab-86a9-2a547a43f815 service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:22:45.162448 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89cbb-7226-49ab-86a9-2a547a43f815 service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:22:45.162717 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89cbb-7226-49ab-86a9-2a547a43f815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:22:45.173025 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed89cbb-7226-49ab-86a9-2a547a43f815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:22:45.174613 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed89cbb-7226-49ab-86a9-2a547a43f815 service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:22:45.184125 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 513/1018] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:22:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:22:47.377962 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=22 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:22:53.383781 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278463d-07d7-4b5a-8a87-ef1b13c34a55 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:22:53.384405 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278463d-07d7-4b5a-8a87-ef1b13c34a55 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:22:53.384405 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278463d-07d7-4b5a-8a87-ef1b13c34a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:22:53.403825 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-b278463d-07d7-4b5a-8a87-ef1b13c34a55 None None] MFA Rules not processed for user `d0444849cf1a42508876bd71e9fae2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:22:53.405131 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-b278463d-07d7-4b5a-8a87-ef1b13c34a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:22:53.411968 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 506/1019] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:22:53 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:22:54.006473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f933f-e159-4f50-8560-99f191bd6cec None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:22:54.006920 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f933f-e159-4f50-8560-99f191bd6cec None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:22:54.007148 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f933f-e159-4f50-8560-99f191bd6cec None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:22:54.008843 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 514/1020] 10.222.0.16 () {54 vars in 961 bytes} [Thu Oct 20 19:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 19:22:54.014519 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5ea7-95c8-417c-9eb8-dda660cf33db None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:22:54.014810 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5ea7-95c8-417c-9eb8-dda660cf33db None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:22:54.015117 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5ea7-95c8-417c-9eb8-dda660cf33db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:22:54.074475 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-f6cf5ea7-95c8-417c-9eb8-dda660cf33db None None] MFA Rules not processed for user `43fc68da6f184762a5e7312ce37f4988`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:22:54.076253 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-f6cf5ea7-95c8-417c-9eb8-dda660cf33db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:22:54.085564 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 507/1021] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Oct 20 19:22:54 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:22:54.093729 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f933f-e159-4f50-8560-99f191bd6cec None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:22:54.108671 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f933f-e159-4f50-8560-99f191bd6cec None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:22:54.114407 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0289bd3-9dbc-41d6-889f-8d890142b674 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43fc68da6f184762a5e7312ce37f4988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:22:54.115138 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0289bd3-9dbc-41d6-889f-8d890142b674 service placement] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:22:54.115492 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0289bd3-9dbc-41d6-889f-8d890142b674 service placement] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:22:54.115770 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0289bd3-9dbc-41d6-889f-8d890142b674 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:22:54.125970 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0289bd3-9dbc-41d6-889f-8d890142b674 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:22:54.128634 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0289bd3-9dbc-41d6-889f-8d890142b674 service placement] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:22:54.140549 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 515/1022] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:22:54 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:23:04.072710 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=17 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:23:04.135618 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=12 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:23:05.024431 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf5ea7-95c8-417c-9eb8-dda660cf33db None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:23:05.035491 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf5ea7-95c8-417c-9eb8-dda660cf33db None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:23:05.039572 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda65bd-5cc3-4416-ac14-fff6396066e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:23:05.040189 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda65bd-5cc3-4416-ac14-fff6396066e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:23:05.040499 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda65bd-5cc3-4416-ac14-fff6396066e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:23:05.040774 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda65bd-5cc3-4416-ac14-fff6396066e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:23:05.048617 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda65bd-5cc3-4416-ac14-fff6396066e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:23:05.050053 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda65bd-5cc3-4416-ac14-fff6396066e3 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:23:05.057845 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 508/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:23:05 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:23:11.733449 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0289bd3-9dbc-41d6-889f-8d890142b674 service placement] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:23:11.745842 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0289bd3-9dbc-41d6-889f-8d890142b674 service placement] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:23:11.753172 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bb06a-6ce8-413a-995b-73ba5dcaa5cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:23:11.753799 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bb06a-6ce8-413a-995b-73ba5dcaa5cb service nova] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:23:11.754081 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bb06a-6ce8-413a-995b-73ba5dcaa5cb service nova] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:23:11.754351 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bb06a-6ce8-413a-995b-73ba5dcaa5cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:23:11.763473 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bb06a-6ce8-413a-995b-73ba5dcaa5cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:23:11.765756 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bb06a-6ce8-413a-995b-73ba5dcaa5cb service nova] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:23:11.775808 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 516/1024] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:23:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:23:15.054507 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=6 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:23:19.992084 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda65bd-5cc3-4416-ac14-fff6396066e3 service neutron] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:23:20.000889 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda65bd-5cc3-4416-ac14-fff6396066e3 service neutron] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:23:20.004733 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82826ebb-7af6-42ed-a324-512c2d8a5832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:23:20.005327 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82826ebb-7af6-42ed-a324-512c2d8a5832 service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:23:20.005601 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82826ebb-7af6-42ed-a324-512c2d8a5832 service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:23:20.005867 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82826ebb-7af6-42ed-a324-512c2d8a5832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:23:20.014554 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82826ebb-7af6-42ed-a324-512c2d8a5832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:23:20.015964 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82826ebb-7af6-42ed-a324-512c2d8a5832 service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:23:20.025167 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 509/1025] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:23:19 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:23:21.771644 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=6 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:23:30.021295 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=6 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:24:28.437170 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238c1b0-7413-470f-814b-933587b91400 None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:24:28.437790 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238c1b0-7413-470f-814b-933587b91400 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:24:28.437790 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238c1b0-7413-470f-814b-933587b91400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:24:28.457537 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-4238c1b0-7413-470f-814b-933587b91400 None None] MFA Rules not processed for user `91653d9246be453db87c7757205049d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:24:28.458731 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-4238c1b0-7413-470f-814b-933587b91400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:24:28.465463 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 517/1026] 10.222.0.16 () {58 vars in 958 bytes} [Thu Oct 20 19:24:28 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 19:24:38.452228 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=3 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:25:27.937004 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82826ebb-7af6-42ed-a324-512c2d8a5832 service neutron] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:25:27.986516 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82826ebb-7af6-42ed-a324-512c2d8a5832 service neutron] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:25:27.991834 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e29c50-8aad-4a95-95f3-50f46a4578e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc6df159e6dc419cae222ebc3e5c99f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:25:27.992474 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e29c50-8aad-4a95-95f3-50f46a4578e1 service nova] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:27.992753 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e29c50-8aad-4a95-95f3-50f46a4578e1 service nova] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:27.993020 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e29c50-8aad-4a95-95f3-50f46a4578e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:28.003113 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e29c50-8aad-4a95-95f3-50f46a4578e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:25:28.004990 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e29c50-8aad-4a95-95f3-50f46a4578e1 service nova] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:25:28.017145 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 510/1027] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:25:27 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:25:35.368933 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238c1b0-7413-470f-814b-933587b91400 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:25:35.381590 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238c1b0-7413-470f-814b-933587b91400 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:25:35.385136 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15772066-ac9c-40d5-bd74-671e282845ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:25:35.385751 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772066-ac9c-40d5-bd74-671e282845ed service neutron] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:35.386025 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772066-ac9c-40d5-bd74-671e282845ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:35.386290 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772066-ac9c-40d5-bd74-671e282845ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:35.456342 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15772066-ac9c-40d5-bd74-671e282845ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:25:35.458786 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15772066-ac9c-40d5-bd74-671e282845ed service neutron] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:25:35.477772 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 518/1028] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:25:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:25:38.013434 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=20 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:25:38.809863 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4691f3-d3ba-40c4-87c7-5cfb73ff6079 None None] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:38.810209 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4691f3-d3ba-40c4-87c7-5cfb73ff6079 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:38.810483 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4691f3-d3ba-40c4-87c7-5cfb73ff6079 None None] PATH_INFO: `/` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:38.811900 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 511/1029] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 19:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:25:38.822388 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807521f-a2db-4f8e-8208-90b64a04274f None None] REQUEST_METHOD: `POST` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:38.822844 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807521f-a2db-4f8e-8208-90b64a04274f None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:38.823005 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807521f-a2db-4f8e-8208-90b64a04274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:38.861999 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.auth.core [None req-5807521f-a2db-4f8e-8208-90b64a04274f None None] MFA Rules not processed for user `43fc68da6f184762a5e7312ce37f4988`. Rule list: `[]` (Enabled: `True`). {{(pid=88308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:25:38.863206 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-5807521f-a2db-4f8e-8208-90b64a04274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:25:38.883872 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 519/1030] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 19:25:38 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:25:38.907983 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4691f3-d3ba-40c4-87c7-5cfb73ff6079 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:25:38.910079 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-aa4691f3-d3ba-40c4-87c7-5cfb73ff6079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:25:38.928460 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4691f3-d3ba-40c4-87c7-5cfb73ff6079 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:25:38.933605 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfc1e5-3071-4a86-ac29-40f5a1c0460a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43fc68da6f184762a5e7312ce37f4988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:25:38.934222 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfc1e5-3071-4a86-ac29-40f5a1c0460a service placement] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:38.934496 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfc1e5-3071-4a86-ac29-40f5a1c0460a service placement] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:38.934765 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfc1e5-3071-4a86-ac29-40f5a1c0460a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:38.944183 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfc1e5-3071-4a86-ac29-40f5a1c0460a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:25:38.945721 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfc1e5-3071-4a86-ac29-40f5a1c0460a service placement] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:25:38.956188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 512/1031] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:25:38 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:25:42.007213 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f755d-85ac-4073-a1e7-69f788224435 None None] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:42.007776 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f755d-85ac-4073-a1e7-69f788224435 None None] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:42.007776 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f755d-85ac-4073-a1e7-69f788224435 None None] PATH_INFO: `/` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:42.009091 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 520/1032] 10.222.0.16 () {54 vars in 921 bytes} [Thu Oct 20 19:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 19:25:42.015447 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91e8f7-4b69-4741-b149-3676e4c6fea4 None None] REQUEST_METHOD: `POST` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:42.015902 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91e8f7-4b69-4741-b149-3676e4c6fea4 None None] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:42.015986 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91e8f7-4b69-4741-b149-3676e4c6fea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:42.038142 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.auth.core [None req-3b91e8f7-4b69-4741-b149-3676e4c6fea4 None None] MFA Rules not processed for user `43fc68da6f184762a5e7312ce37f4988`. Rule list: `[]` (Enabled: `True`). {{(pid=88307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 19:25:42.039337 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-3b91e8f7-4b69-4741-b149-3676e4c6fea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:25:42.047910 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 513/1033] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Oct 20 19:25:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 19:25:42.074831 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f755d-85ac-4073-a1e7-69f788224435 None None] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:25:42.093177 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f755d-85ac-4073-a1e7-69f788224435 None None] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:25:42.094246 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91e8f7-4b69-4741-b149-3676e4c6fea4 None None] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:25:42.106435 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb8aa9-6e67-428e-bc00-7abb099d2f36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43fc68da6f184762a5e7312ce37f4988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:25:42.107065 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb8aa9-6e67-428e-bc00-7abb099d2f36 service placement] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:42.107338 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb8aa9-6e67-428e-bc00-7abb099d2f36 service placement] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:42.107603 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb8aa9-6e67-428e-bc00-7abb099d2f36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:42.107887 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91e8f7-4b69-4741-b149-3676e4c6fea4 None None] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:25:42.113198 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:25:42.115192 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:42.115776 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:42.116259 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] PATH_INFO: `/v3/users/d0444849cf1a42508876bd71e9fae2e6` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:42.117865 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0444849cf1a42508876bd71e9fae2e6)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:25:42.118004 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb8aa9-6e67-428e-bc00-7abb099d2f36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:25:42.119619 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb8aa9-6e67-428e-bc00-7abb099d2f36 service placement] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:25:42.120650 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:25:42.132454 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 521/1034] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:25:42 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:25:42.196976 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0444849cf1a42508876bd71e9fae2e6'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.204926 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0444849cf1a42508876bd71e9fae2e6'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.205663 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0444849cf1a42508876bd71e9fae2e6'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.206271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0444849cf1a42508876bd71e9fae2e6'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.215834 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0444849cf1a42508876bd71e9fae2e6'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.235814 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 514/1035] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 19:25:42 2022] DELETE /identity/v3/users/d0444849cf1a42508876bd71e9fae2e6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:25:42.421416 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb8aa9-6e67-428e-bc00-7abb099d2f36 service placement] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:25:42.433521 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb8aa9-6e67-428e-bc00-7abb099d2f36 service placement] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:25:42.493767 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:25:42.494319 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:42.494596 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:42.494870 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] PATH_INFO: `/v3/projects/073a564090e8442abf7ff94cab6add4f` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:42.495977 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073a564090e8442abf7ff94cab6add4f)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:25:42.497943 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:25:42.530140 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:25:42.546641 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073a564090e8442abf7ff94cab6add4f', 'request_id': 'req-e0f34ed7-894b-40dd-be97-65b11ba2c410'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.556734 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073a564090e8442abf7ff94cab6add4f', 'request_id': 'req-e0f34ed7-894b-40dd-be97-65b11ba2c410'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.564041 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073a564090e8442abf7ff94cab6add4f', 'request_id': 'req-e0f34ed7-894b-40dd-be97-65b11ba2c410'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.586722 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] The token cache is being invalidate because project 073a564090e8442abf7ff94cab6add4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88308) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 19:25:42.587001 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.587611 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.589116 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 522/1036] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 19:25:42 2022] DELETE /identity/v3/projects/073a564090e8442abf7ff94cab6add4f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:25:42.593082 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:25:42.594482 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:25:42.607508 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84bb9b-6e20-4908-93ef-af990f3bd785 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:25:42.666984 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:25:42.667605 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:42.667882 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:42.668146 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] PATH_INFO: `/v3/users/7966bf37de9a407ba19b8e1a1cafaf87` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:42.669294 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7966bf37de9a407ba19b8e1a1cafaf87)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:25:42.671185 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:25:42.718581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7966bf37de9a407ba19b8e1a1cafaf87'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.724390 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:25:42.726624 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7966bf37de9a407ba19b8e1a1cafaf87'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.727677 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7966bf37de9a407ba19b8e1a1cafaf87'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.728417 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7966bf37de9a407ba19b8e1a1cafaf87'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.735682 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7966bf37de9a407ba19b8e1a1cafaf87'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:42.752928 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 515/1037] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 19:25:42 2022] DELETE /identity/v3/users/7966bf37de9a407ba19b8e1a1cafaf87 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:25:42.918871 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:25:42.920422 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:25:42.934562 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f34ed7-894b-40dd-be97-65b11ba2c410 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:25:42.992982 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:25:42.993616 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:25:42.993893 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:25:42.994163 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] PATH_INFO: `/v3/projects/b7ebe29be418471da8b0c2c38256301f` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:25:42.995266 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ebe29be418471da8b0c2c38256301f)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:25:42.997230 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:25:43.044418 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ebe29be418471da8b0c2c38256301f', 'request_id': 'req-31fd0a33-b267-4e19-86a8-ce4753776239'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:43.050334 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ebe29be418471da8b0c2c38256301f', 'request_id': 'req-31fd0a33-b267-4e19-86a8-ce4753776239'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:43.058068 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ebe29be418471da8b0c2c38256301f', 'request_id': 'req-31fd0a33-b267-4e19-86a8-ce4753776239'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:43.068558 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] The token cache is being invalidate because project b7ebe29be418471da8b0c2c38256301f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88308) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 19:25:43.068840 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:43.069459 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:25:43.070935 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 523/1038] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 19:25:42 2022] DELETE /identity/v3/projects/b7ebe29be418471da8b0c2c38256301f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:25:52.749387 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=9,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:25:53.065336 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=70,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:26:08.098093 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:26:08.099561 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:26:08.154581 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f25c1-117f-493a-b975-590f9fe73808 admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:26:08.201597 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933dde3-e19e-43dd-9870-68166d6dc30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09fce752a3264bb19af1260da2b83315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:26:08.202136 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933dde3-e19e-43dd-9870-68166d6dc30e service neutron] REQUEST_METHOD: `GET` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:26:08.202412 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933dde3-e19e-43dd-9870-68166d6dc30e service neutron] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:26:08.202683 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933dde3-e19e-43dd-9870-68166d6dc30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:26:08.204433 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-5933dde3-e19e-43dd-9870-68166d6dc30e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:26:08.264915 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933dde3-e19e-43dd-9870-68166d6dc30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:26:08.266341 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933dde3-e19e-43dd-9870-68166d6dc30e service neutron] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:26:08.276461 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 516/1039] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:26:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:26:14.867034 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:26:14.868704 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:26:14.882202 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd0a33-b267-4e19-86a8-ce4753776239 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:26:14.886802 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:26:14.887424 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:26:14.887703 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:26:14.887979 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] PATH_INFO: `/v3/users/91653d9246be453db87c7757205049d2` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:26:14.889144 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91653d9246be453db87c7757205049d2)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:26:14.890149 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: WARNING py.warnings [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:26:14.890149 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: warnings.warn(msg) Oct 20 19:26:14.890149 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: Oct 20 19:26:14.891361 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:26:14.954229 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91653d9246be453db87c7757205049d2'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:14.954997 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91653d9246be453db87c7757205049d2'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:14.965159 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91653d9246be453db87c7757205049d2'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:14.965792 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91653d9246be453db87c7757205049d2'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:14.972951 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91653d9246be453db87c7757205049d2'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:14.998036 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 524/1040] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 19:26:14 2022] DELETE /identity/v3/users/91653d9246be453db87c7757205049d2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:26:15.169356 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933dde3-e19e-43dd-9870-68166d6dc30e service neutron] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:26:15.180651 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933dde3-e19e-43dd-9870-68166d6dc30e service neutron] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:26:15.240553 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:26:15.241188 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:26:15.241467 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:26:15.241736 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] PATH_INFO: `/v3/projects/c51ec6c9eb634fb99f2e9c03990275fe` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:26:15.242844 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51ec6c9eb634fb99f2e9c03990275fe)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:26:15.243878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: WARNING py.warnings [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 19:26:15.243878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: warnings.warn(msg) Oct 20 19:26:15.243878 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: Oct 20 19:26:15.245095 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:26:15.253271 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=100 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:26:15.299058 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51ec6c9eb634fb99f2e9c03990275fe', 'request_id': 'req-c3786b01-5aad-4c96-a414-3a06d6eac0fc'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.312671 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51ec6c9eb634fb99f2e9c03990275fe', 'request_id': 'req-c3786b01-5aad-4c96-a414-3a06d6eac0fc'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.320740 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51ec6c9eb634fb99f2e9c03990275fe', 'request_id': 'req-c3786b01-5aad-4c96-a414-3a06d6eac0fc'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.331696 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] The token cache is being invalidate because project c51ec6c9eb634fb99f2e9c03990275fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 19:26:15.331986 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.332641 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.334124 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 517/1041] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 19:26:15 2022] DELETE /identity/v3/projects/c51ec6c9eb634fb99f2e9c03990275fe => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:26:15.338122 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:26:15.339513 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:26:15.353225 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b325315-779b-4c39-9091-800340961f21 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:26:15.408202 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:26:15.408789 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:26:15.409595 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:26:15.410070 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] PATH_INFO: `/v3/users/f75dfc3207ab4185987e2eddebd1e0a8` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:26:15.411123 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75dfc3207ab4185987e2eddebd1e0a8)` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:26:15.413080 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:26:15.460345 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75dfc3207ab4185987e2eddebd1e0a8'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.461025 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75dfc3207ab4185987e2eddebd1e0a8'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.469974 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75dfc3207ab4185987e2eddebd1e0a8'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.470639 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75dfc3207ab4185987e2eddebd1e0a8'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.479184 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.notifications [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75dfc3207ab4185987e2eddebd1e0a8'} {{(pid=88308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.488213 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:26:15.501058 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 525/1042] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Oct 20 19:26:15 2022] DELETE /identity/v3/users/f75dfc3207ab4185987e2eddebd1e0a8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:26:15.673615 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] Authenticating user token {{(pid=88307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:26:15.675142 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.fernet_utils [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:26:15.689174 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3786b01-5aad-4c96-a414-3a06d6eac0fc admin admin] Validating token access rules against request {{(pid=88307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:26:15.747258 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc589496feb245fc97089364fc0bb055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb75e3ae7a47470dbe383104be65755f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:26:15.747879 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:26:15.748148 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:26:15.748491 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] PATH_INFO: `/v3/projects/bcd0c74aef524657b7d8570942d87d99` {{(pid=88307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:26:15.749626 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd0c74aef524657b7d8570942d87d99)` {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:26:15.751604 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] RBAC: Authorization granted {{(pid=88307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:26:15.797574 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd0c74aef524657b7d8570942d87d99', 'request_id': 'req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.803720 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd0c74aef524657b7d8570942d87d99', 'request_id': 'req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.810956 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd0c74aef524657b7d8570942d87d99', 'request_id': 'req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5'} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.821451 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] The token cache is being invalidate because project bcd0c74aef524657b7d8570942d87d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 19:26:15.821737 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.822359 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG keystone.notifications [None req-00a6b5b8-fe75-4b3a-a82a-59dbe4814fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 19:26:15.823831 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: [pid: 88307|app: 0|req: 518/1043] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Oct 20 19:26:15 2022] DELETE /identity/v3/projects/bcd0c74aef524657b7d8570942d87d99 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 19:26:25.502048 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:26:25.818267 dv-osbrick-862183-1-ceph devstack@keystone.service[88307]: DEBUG dbcounter [-] [88307] Writing DB stats keystone:SELECT=72,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 19:26:41.091088 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] Authenticating user token {{(pid=88308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 19:26:41.092497 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:26:41.160695 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1097f37-0327-468b-b231-86ed324caa37 admin admin] Validating token access rules against request {{(pid=88308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 19:26:41.218217 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad89ba8-64f3-48f1-bd22-214d5986df61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43fc68da6f184762a5e7312ce37f4988', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75fce313b5e242adb9eb825bc017e358', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 19:26:41.218812 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad89ba8-64f3-48f1-bd22-214d5986df61 service placement] REQUEST_METHOD: `GET` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 19:26:41.219091 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad89ba8-64f3-48f1-bd22-214d5986df61 service placement] SCRIPT_NAME: `/identity` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 19:26:41.219363 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad89ba8-64f3-48f1-bd22-214d5986df61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 19:26:41.221115 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.fernet_utils [None req-1ad89ba8-64f3-48f1-bd22-214d5986df61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 19:26:41.232588 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad89ba8-64f3-48f1-bd22-214d5986df61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 19:26:41.234149 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad89ba8-64f3-48f1-bd22-214d5986df61 service placement] RBAC: Authorization granted {{(pid=88308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 19:26:41.243668 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: [pid: 88308|app: 0|req: 526/1044] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Oct 20 19:26:41 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 19:26:51.239705 dv-osbrick-862183-1-ceph devstack@keystone.service[88308]: DEBUG dbcounter [-] [88308] Writing DB stats keystone:SELECT=58 {{(pid=88308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}